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Abstract 


The  results  of  formative  assessments  are  regularly  used  to  infonn  important  instructional 
decisions  (e.g.,  targeted  intervention)  within  a response  to  intervention  (RTI)  system  of 
teaching  and  learning.  The  validity  of  such  instructional  decision-making  depends,  in 
part,  on  the  alignment  between  formative  measures  and  the  academic  content  standards 
on  which  classroom  instruction  is  based,  as  well  as  the  technical  adequacy  of  the 
measures  used  in  RTI  applications.  In  the  following  technical  report,  we  describe  the 
development  and  scaling  of  the  easyCBM  Common  Core  State  Standards  elementary 
school  mathematics  measures  for  use  within  an  RTI  framework.  Within  a given  grade, 
math  items  from  two  distinct  item  pools  were  calibrated  to  a common  horizontal  scale 
using  a 1 -parameter  Rasch  analysis.  The  results  of  the  scaling  were  then  used  to 
construct  13  alternate  forms  designed  to  be  of  comparable  difficulty  - 3 forms  designated 
for  seasonal  benchmark  screening  and  10  designated  for  progress  monitoring.  Prior  and 
subsequent  grade-level  math  items  were  added  to  the  benchmark  test  fonns  as  a basis  for 
constructing  a common  vertical  scale  in  the  future.  Evidence  of  technical  adequacy  is 
reported  in  appendices  by  both  test  form  and  by  the  full  bank  of  CCSS  items  piloted  and 


scaled. 
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The  Development  and  Scaling  of  the  easyCBM  CCSS 
Elementary  Mathematics  Measures:  Grade  4 

The  mathematics  measures  from  the  easyCBM  interim-formative  assessment  system  for 
grades  K-8  were  designed  for  use  in  a Response  to  Intervention  (RTI)  framework  (Alonzo,  Lai, 

& Tindal,  2009a,  2009b,  2009c;  Alonzo  & Tindal,  2009a,  2009b;  Lai,  Alonzo,  & Tindal,  2009), 
which  can  be  used  both  for  whole-school  improvement  (Shores  & Chester,  2009)  as  well  as  to 
identify  students  in  need  of  special  education  services  (VanDerHeyden,  Witt,  & Gilbertson, 
2007).  A functional  RTI  system  hinges  on  the  use  of  measures  that  are  aligned  with  adopted 
content  standards,  so  that  instructional  decisions  are  based  on  results  from  student  assessment 
that  reflect  what  they  are  learning  in  their  classrooms  (Fuchs  & Fuchs,  2006).  The  easyCBM 
measures  were  originally  developed  to  align  with  the  National  Council  of  Teachers  of 
Mathematics  (NCTM)  Focal  Points  Standards  (Nese  et  al.,  2010),  that  were  adopted  by  many 
states  as  the  basis  for  teaching  mathematics. 

In  2010  the  Common  Core  State  Standards  (CCSS)  were  released  as  a guide  for  preparing 
students  for  college  and  careers  (National  Governors  Association  Center  for  Best  Practices  & 
Council  of  Chief  State  School  Officers,  2010).  The  subsequent  endorsement  of  the  standards  by 
the  U.S.  Department  of  Education  (2010)  and  their  recommendation  of  creating  assessments  that 
provide  improved  measurement  of  student  progress  toward  skills  outlined  in  the  CCSS, 
coincided  with  a majority  of  states  adopting  the  CCSS  as  the  basis  for  student  instruction  and 
assessment  (National  Governors  Association  Center  for  Best  Practices  & Council  of  Chief  State 
School  Officers,  2010).  Similarly,  developers  of  curriculum-based  measurements  (CBM),  long 
used  to  monitor  growth  toward  general  outcomes  and  skill  mastery  through  multiple  short, 
technically  adequate,  and  sufficiently  equivalent  test  forms  (e.g.,  Deno,  2003;  Tindal,  2013),  also 
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began  work  to  align  their  measures  with  the  CCSS.  A study  of  existing  easyCBM  math 
measures  to  determine  the  extent  to  which  they  were  in  alignment  with  the  CCSS  followed  in 
2012  (Irvin,  Park,  Alonzo,  & Tindal,  2012a,  2012b;  Park,  Irvin,  Alonzo,  & Tindal,  2012). 

The  2012  alignment  studies  found  reasonable  alignment  between  the  easyCBM 
mathematics  measures  and  the  CCSS  for  grades  K-5;  however,  gaps  across  specific  grade-level 
domains  and  standards  remained.  Identification  of  these  gaps  provided  the  basis  for  developing 
new  technically  adequate  K-5  CCSS-aligned  math  items  and  test  forms  for  use  in  the  easyCBM 
interim-formative  assessment  system  and  in  RTI  application  - the  development,  piloting  and 
scaling  of  which  are  discussed  in  this  technical  report. 

Methods 

In  developing  the  easyCBM  CCSS  mathematics  measures,  we  focused  on  alignment  with 
the  CCSS  and  accessibility  for  diverse  student  populations  with  a range  of  achievement  levels. 
The  following  section  outlines  the  process  we  used  to  develop  math  items  and  subsequently 
assemble  benchmarking  and  progress  monitoring  test  forms  for  use  in  RTI  frameworks  of 
teaching  and  learning. 

Item  Development 

The  K-5  CCSS  in  mathematics  are  comprised  of  four  (Grades  1 and  2)  or  five  (Grades  K, 
3-5)  domains  that  are  further  divided  into  21-28  individual  standards.  Though  some  grade- 
level  standards  were  further  divided  into  more  granular  sub-standards,  such  sub-standards  were 
treated  as  part  of  the  larger  standard;  thus,  an  item  written  to  a given  sub-standard  was 
considered  as  being  written  to  its  parent  standard.  A total  of  3,000  new  CCSS  math  items  were 
written,  500  items  in  each  of  grades  K-5,  based  on  the  gaps  in  CCSS  coverage  identified  through 
previous  research  (Irvin  et  ah,  2012b;  Park  et  ah,  2012). 
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Item  writing  and  review  training.  Two  groups  were  recruited  to  develop  CCSS  math 
items  based  on  their  experience  and  expertise  in  mathematics  teaching  and  learning.  Four  item 
writers  for  each  of  three  grade  bands:  K-l,  2-3  and  4-5,  and  six  item  reviewers,  one  for  each  of 
grades  K-5,  were  recruited.  One  of  the  original  four  item  writers  voluntarily  dropped  from  the 
study,  and  thus,  two  item  writers  split  their  duties  within  the  grade  4-5  band.  Writers  and 
reviewers  were  recruited  to  develop  and  review  math  items  appropriate  to  their  expertise.  On 
average,  item  writers  and  reviewers  had  about  14  years  of  teaching  experience  in  math  education, 
ranging  from  3-32  years.  Each  item  writer/reviewer  held  a Bachelor’s  degree  and  16  of  the  18 
(including  all  reviewers)  also  held  a Master’s  degree.  Item  writers  were  recruited  in  a manner  to 
balance  expertise  across  general  and  special  education  classrooms.  All  item  reviewers  had 
demonstrated  expertise  in  both  general  and  special  education  and  also  worked  in  district 
leadership  positions,  for  example,  as  math  coaches  or  curriculum  developers. 

In  December  2012,  item  writers  and  reviewers  attended  one  of  four  mandatory  2.5-hour 
training  webinars,  led  by  the  lead  project  researcher,  who  was  onsite  at  the  offices  of  Behavioral 
Research  and  Teaching  (BRT)  at  the  University  of  Oregon.  The  webinar  training  consisted  of 
two  main  sections.  An  initial  study  overview  reviewed  the  context  of  the  research  study  and 
described  item  writing  and  reviewing  duties  in  detail.  Specifically,  for  each  new  CCSS  math 
item,  item  writers  and  reviewers  were  required  to  write  a stem  (question  or  prompt)  and  three 
answer  choices  (one  correct  and  two  distractors)  that  were  similar  in  length  and  complexity  level. 
When  constructing  distractor  options,  writers  and  reviewers  were  informed  that  they  should  be 
relevant  to  the  math  skills  required  by  the  problem  - ideally  targeting  a range  of  plausible  student 
mistakes.  Item  writers  and  reviewers  could  also  include  graphics  for  the  stem  and/or  answer 
options  when  relevant  to  the  problem.  When  graphics  were  called  for,  item  writers  provided  a 
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rough  sketch  and/or  description  of  the  graphic,  and  a graphic  artist  later  created  digital  images 
for  each  of  the  graphics.  The  second  training  section  focused  on  techniques  around  effective  and 
appropriate  item  writing,  and  included  principles  of  quality  item/test  development  as  outlined  by 
Haladyna  (2004)  and  Downing  (2006a,  2006b),  and  those  around  Universal  Design  for 
Assessment  (e.g.,  precise  construct  targets,  accessibility  to  diverse  populations,  lack  of  bias)  as 
outlined  by  Thompson,  Johnstone,  and  Thurlow  (2002). 

Throughout  each  section  of  the  webinar  training,  item  writers  and  reviewers  were 
required  to  collaboratively  participate  in  activities  designed  to  ensure  deep  understanding  of 
study  roles,  including  observation  and  discussion  of  math  items.  In  other  words,  a variety  of 
math  items  were  shown  to  writers  and  reviewers,  followed  by  a discussion  of  why  they  met  or 
did  not  meet  the  principles  of  quality  item/test  development  or  why  they  were  (or  were  not) 
aligned  to  the  CCSS.  The  lead  researcher,  writer  and  reviewers  brainstormed  and  discussed 
specific  ways  in  which  items  could  be  altered  to  meet  item  design  principles  or  better  align  to  an 
identified  CCSS  in  instances  where  non-examples  were  shown.  Particular  attention  was  paid  to 
crafting  effective  distractor  options  and  graphics  options  associated  with  math  items.  Effective 
multiple-choice  items  typically  have  one  distractor  option  that  is  “closer”  to  the  correct  response 
and  one  distractor  that  is  “further”  from  the  correct  response  (Haladyna,  2004)  - the  third 
response  option  being  the  correct  answer  for  a given  math  item.  Graphics,  whether  for  the  stem 
and/or  answer  options,  are  included  for  a math  item  only  as  necessary  to  meet  a targeted  content 
standard  and  to  critically  consider  and  solve  a given  math  problem.  This  was  the  manner  in 
which  writers  were  asked  to  write  answer  options  and  include  graphics  for  this  study.  At  the  end 
of  the  training  webinar,  the  item  writing  process  was  again  described  in  detail,  including  the 
specific  roles  of  item  writers  and  reviewers,  in  connection  with  expected  timelines  and 
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deliverables.  The  PowerPoint  Slides  used  in  the  webinar  training  were  adapted  from  those  used 
in  Anderson,  Irvin,  Patarapichayatham,  Alonzo,  and  Tindal  (2012),  and  are  shown  in  Appendix 
A. 

Item  writing.  In  general,  item  writers  and  reviewers  worked  concurrently  to  write,  edit 
and  revise  500  new  CCSS-aligned  math  items  (four  item  sets)  in  each  of  grades  K-5. 

Specifically,  item  writers  wrote  250  new  math  items:  125  items  (in  each  of  two  items  sets)  for 
each  grade  of  their  assigned  grade  band  (i.e.,  K-l,  2-3  or  4-5).  For  example,  “item  writer  1”  was 
assigned  to  write  125  math  items  in  each  of  Grades  K and  1 to  align  with  the  targeted  CCSS. 
Table  1 displays  the  math  item  writing  plan  for  fourth  grade  by  item  set  and  CCSS.  Item  writers 
iteratively  wrote  and  submitted  items  to  the  lead  researcher  (and  item  reviewers)  in  small  batches 
between  January  and  March  2013,  typically  submitting  between  10-25  items  at  a time  for  further 
review  and  editing.  Throughout  the  iterative  item  writing  process,  item  writers  and  reviewers 
were  in  contact  with  the  lead  researcher  by  email  and  phone  to  hone  their  skills,  and  thus,  the 
quality  and  consistency  of  math  items  produced. 

Item  review.  We  conducted  three  separate  stages  of  item  review  prior  to  item  scaling: 

(a)  review  by  contracted  item  reviewers,  (b)  an  internal  review  by  University  of  Oregon 
education  researchers  at  BRT,  and  (c)  an  external  review  by  individuals  without  prior  connection 
to  the  items.  The  first  review  took  place  concurrently  with  item  writing,  in  which  a single  item 
reviewer  was  assigned  to  review  all  500  math  items  for  a given  grade  level  (K-5).  Prior  to 
contracted  item  reviewers  receiving  items,  the  lead  researcher  briefly  reviewed  the  small  batches 
of  submitted  items  for  completeness,  accuracy  and  features  consistent  with  effective  item  writing 
discussed  during  the  webinar  training  (e.g.,  effective  items,  Universal  Design  for  Assessment), 
subsequently  passing  them  to  the  assigned  reviewer  concurrent  with  the  item  writing  process. 
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Item  reviewers  then  carefully  reviewed  and  edited  each  grade  level  math  item  for  completeness, 
accuracy  and  features  consistent  with  effective  item  writing  discussed  during  the  webinar 
training  - this  included  editing  for  distractor  and  graphical  option  appropriateness.  Further, 
because  item  reviewers  had  access  to  125  items  from  each  of  four  item  writers,  they  also  edited 
math  items  that  were  too  similar  (across  item  writers)  while  attempting  to  maintain  the  content 
and  skill  intention  of  the  item  writers. 

For  the  second  stage  of  item  review,  all  math  items  (subsequent  to  graphics  development 
- see  below)  were  uploaded  to  a secure  website  to  be  reviewed  as  students  would  see  them  in  the 
online  easyCBM  formative  assessment  environment.  Math  items  were  then  assigned  and 
reviewed  internally  by  a group  of  university  education  researchers  from  BRT.  Reviewers 
included  university  faculty  and  doctoral  students  in  education  research  with  experience  in  test 
and  item  development.  During  the  internal  review,  reviewers  again  analyzed  and  edited  items 
for  mathematical  correctness  while  also  looking  for  possible  bias  or  features  inconsistent  with 
Universal  Design  for  Assessment  principles.  Additionally,  internal  reviewers  ensured  that  all 
items  were  formatted  in  a consistent  manner.  All  reviewers  during  this  stage  had  been  trained 
and  taken  part  in  a previous  internal  review  of  middle  school  math  items  (Anderson  et  ah,  2012), 
and  thus,  were  deemed  competent  to  serve  on  the  internal  review  team  in  the  current  study.  A 
team  of  external  reviewers  without  prior  connection  to  the  item  development  conducted  the  final 
item  review.  We  contracted  with  three  individuals  who  did  not  have  item  writing  or  mathematics 
teaching/assessment  experience  to  review  math  items  (on  the  secure  website)  for  mathematical 
accuracy,  consistent  formatting,  and  audio  file  accuracy  (see  below).  Our  intention  behind  this 
manner  of  external  review  was  to  have  a “fresh  look”  at  the  math  items  apart  from  the  item 
writers,  various  reviewers  and  the  lead  researcher,  all  of  whom  had  had  considerable  prior 
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contact  with  the  math  items. 

Graphics  and  audio  development.  We  contracted  with  a professional  graphics  artist  to 
produce  images  for  all  math  items.  The  artist  used  Adobe  Illustrator  to  develop  simple  and  clear 
line  drawings  without  shading  consistent  with  Universal  Design  for  Assessment 
recommendations  (Thompson  et  ah,  2002).  The  artist  produced  graphics  only  when  explicitly 
requested  by  the  item  writer/reviewer  - a development  option  for  the  stem  and/or  the  answer 
options  for  a given  math  item.  The  artist  produced  each  item  graphic  based  on  either  a detailed 
written  description  or  a hand-drawn/electronic  version  (e.g.,  a jpeg  found  on  the  Internet) 
provided  by  an  item  writer/reviewer.  Graphic  images  were  iteratively  edited  based  on  feedback 
from  the  three  review  stages.  We  also  contracted  an  individual  to  produce  audio  recordings  of 
written  text  in  all  math  items.  In  the  easyCBM  online  assessment  system,  students  have  the 
option  to  click  on  a speaker  button  next  to  the  stem  and/or  distractor  answer,  which  results  in 
having  the  text-based  portions  of  the  item  “read-aloud”  to  them.  Audio  recordings  were 
reviewed  and  revised  as  necessary  during  the  second  and  third  review  stages  during  item 
development. 

Scaling 

We  carried  out  four  primary  steps  during  the  scaling  of  the  new  K-5  CCSS  math  items: 

(a)  developing  a piloting  plan,  (b)  selecting  anchor  items  from  the  existing  NCTM-based 
easyCBM  and  the  new  CCSS  math  item  pools  to  create  pilot  forms,  (c)  recruiting  subjects  and 
piloting  the  items,  and  (d)  calibrating  grade-level  items  to  a common  scale. 

Piloting  plan.  For  each  of  grades  K-5,  we  developed  a common  piloting  plan,  comprised 
of  15  total  pilot  forms,  to  guide  pilot  form  creation.  We  included  32  total  math  items  in  each 
form  for  grade  K-l,  and  41  total  items  for  grades  2-5.  Of  the  32  or  41  items  in  a given  pilot 
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form,  we  dedicated  5 horizontal  anchor  items  to  link  to  the  previous  pilot  form  and  5 horizontal 
anchor  items  to  link  to  the  subsequent  pilot  form.  For  example,  pilot  form  2 had  5 anchor  items 
linking  to  pilot  form  1,  and  5 anchor  items  linking  to  pilot  form  3.  This  meant  that  there  were  22 
unique  math  items  in  each  of  the  grade-level  pilot  forms  for  grades  K-l,  and  3 1 for  grades  2-5. 
Of  the  10  total  anchor  items  within  a given  pilot  form,  5 were  selected  from  the  existing 
easyCBM  item  pool  - items  originally  written  to  the  NCTM  Focal  Point  Standards  (Nese  et  al., 
2010),  though  deemed  aligned  to  the  CCSS  in  recent  alignment  studies  (Irvin  et  ah,  2012b;  Park 
et  ah,  2012),  and  5 were  selected  from  the  new  CCSS-based  item  pool.  For  simplicity  and 
clarity,  these  two  pools  will  hereto  be  referred  to  as  NCTM  and  CCSS  item  pools,  though  it 
should  be  noted  that  all  items  used  in  this  project  from  both  pools  had  been  deemed  aligned  to 
the  CCSS  (the  full  combined  CCSS  item  bank). 

By  including  horizontal  anchors  from  both  item  pools,  we  were  able  to  more  than  double 
the  size  of  the  overall  item  pool  from  which  we  would  select  items  to  create  the  operational 
CCSS  test  forms  by  calibrating  the  two  original  pools  to  a common  scale.  Additionally,  this 
saved  valuable  item  writing  and  review  resources.  It  should  be  noted  that  unlike  the  piloting 
plan  used  for  the  easyCBM  CCSS  middle  school  math  measure  development  study  (see 
Anderson  et  ah,  2012),  vertical  (across-grade)  anchor  items  were  not  included  in  the  K-5 
piloting.  Rather,  we  included  prior-  and  subsequent-grade  math  items  in  the  operationalized  test 
forms  for  grades  1-5  (and  prior-grade  items  for  grade  K)  in  order  to  calibrate  a common  scale 
over  the  2013-2014  academic  year,  reasoning  far  more  students  would  provide  item-level 
information  for  the  operationalized  items  as  a basis  for  future  review  of  technical  adequacy  of 
items  and  test  forms  (see  fonn  creation,  below).  The  grades  3-5  piloting  plan,  showing  the 
number  and  placement  of  horizontal  anchor  items  selected  from  both  the  existing  NCTM  as  well 
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as  the  CCSS  item  pools,  is  displayed  in  Table  2. 

Choosing  anchors  and  creating  pilot  forms.  A team  of  four  researchers  (including  the 
lead  researcher)  collaborated  to  select  the  anchor  items  from  the  NCTM  and  CCSS  pools  for 
pilot  forms.  One  of  the  researchers  had  a Ph.D.  in  Educational  Measurement  and  Evaluation, 
and  two  were  doctoral  students  in  the  University  of  Oregon’s  Educational  Methodology,  Policy, 
and  Leadership  program.  The  researcher  with  the  Ph.D.  and  both  doctoral  students  were  familiar 
with  the  math  item  development  and  items,  as  they  had  worked  with  the  lead  researcher  during 
item  writing  and  had  served  on  the  internal  item  review  team. 

As  mentioned  earlier,  anchor  items  for  the  current  piloting  were  selected  from  two 
different  item  pools  by  four  researchers.  Items  selected  from  the  K-5  NCTM  pool  had  been 
previously  piloted  and  scaled  (Alonzo  et  ah,  2009a,  2009b,  2009c;  Alonzo  & Tindal,  2009a, 
2009b;  Lai  et  ah,  2009),  and  thus,  item-level  information  was  available  to  guide  anchor  selection. 
Researchers  followed  a number  of  guidelines  when  selecting  anchor  items  from  the  NCTM  pool. 
Anchor  items  were  selected  to  balance  estimated  difficulty  across  all  1 5 pilot  forms  (easy, 
medium,  hard),  while  also  falling  within  the  acceptable  range  of  mean-square  outfit  values  (0.5 
to  1 .5)  recommended  for  reliable  measurement  in  high-stakes  multiple-choice  test  construction 
(Wright  & Linacre,  1994). 

A further  constraint  for  selection  of  anchor  items  from  the  NCTM  pool  was  that  they  be 
aligned  to  the  CCSS.  Based  on  results  from  Irvin  et  al.  (2012b)  and  Park  et  al.  (2012),  we  cross- 
walked  NCTM  Focal  Point  Standards  and  CCSS  that  were  associated  with  each  other  when 
NCTM-written  items  were  deemed  aligned  to  particular  CCSS  in  the  alignment  studies.  In  this 
manner,  items  originally  written  to  the  NCTM  Focal  Point  Standards,  though  not  necessarily 
included  in  the  2012  alignment  studies,  were  deemed  aligned  to  the  CCSS  and  included  in  the 
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pool  from  which  we  selected  anchor  items  in  the  current  study  (in  addition  to  those  items 
specifically  deemed  aligned  in  the  earlier  studies).  Lastly,  we  attempted  to  stratify  anchor  items 
selected  from  the  NCTM  pool  by  CCSS.  For  instance,  in  fourth  grade  there  are  5 different  CCSS 
domains  with  a total  of  37  unique  anchor  items  needed  to  populate  the  15  pilot  forms;  thus,  8-9 
items  were  selected  from  each  CCSS  domain  in  fourth  grade  and  stratified  across  pilot  forms  as 
evenly  as  possible. 

Empirically  estimated  item-level  information  was  not  available  for  items  in  the  new 
CCSS  pool;  thus,  it  was  impossible  to  know  the  difficulty  or  mean-square  outfit  of  items  in  the 
K-5  CCSS  pool  to  guide  anchor  selection.  Therefore,  we  adopted  the  same  anchor  item  selection 
process  used  in  our  previous  easyCBM  CCSS  middle  school  math  item  development  study  (see 
Anderson  et  ah,  2012,  p.  9 and  22),  whereby  our  team  of  four  researchers  worked  together  to 
select  appropriate  anchor  items  for  pilot  forms  based  on:  (a)  an  appropriate  number  of  steps 
required  to  respond  to  the  item  (typically  2-3),  (b)  minimal  language  requirements  outside  of  that 
needed  to  solve  the  math  problem,  (c)  culturally  unbiased  (e.g.,  a blend  of  diverse  names, 
avoiding  overrepresentation  of  subject  matter  unrelated  to  the  targeted  math  knowledge/skills), 
(d)  direct  alignment  to  targeted  CCSS,  and  (e)  consistency  with  principles  of  Universal  Design 
for  Assessment.  As  was  the  case  for  anchor  items  selected  from  the  NCTM  pool,  those  selected 
from  the  CCSS  pool  were  stratified  by  CCSS  domain  in  an  attempt  to  balance  representation 
within  and  across  each  grade-level  pilot  form. 

After  we  selected  horizontal  anchor  items,  we  created  1 5 pilot  forms  for  each  of  grades 
K-5.  For  all  grades,  the  first  4 items  of  each  pilot  fonn  were  unique  items  written  to  the  CCSS  as 
part  of  this  study.  The  next  10  items  (items  5-14)  of  each  form  were  horizontal  anchor  items. 

We  populated  items  5-9  with  anchor  items  selected  from  the  NCTM  pool,  and  items  10-14  with 
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anchor  items  selected  from  the  CCSS  pool.  For  both  bands  of  anchor  items  (5-9  and  10-14), 
either  2 or  3 items  linked  to  previous  or  the  following  pilot  forms  as  shown  in  Table  2.  It  should 
be  noted  that  pilot  forms  1 and  1 5 shared  either  2 or  3 horizontal  anchor  items  between  them, 
given  they  were  at  the  “ends”  of  the  line  of  forms  (i.e.,  form  15  served  as  the  “previous”  form  to 
form  1 and  vice  versa).  In  keeping  with  the  recommendations  of  Kolen  and  Brennan  (2004),  the 
placement  and  order  of  each  anchor  item  were  held  constant  on  a given  pilot  form.  Finally,  the 
unique  items  were  last:  items  15-32  for  grades  K-l,  and  15-41  for  grades  2-5.  All  unique  items 
were  stratified  within  and  across  pilot  forms  by  standard  and  domain  as  appropriate  and  possible 
to  balance  content  representation. 

Participant  recruiting  and  participation.  Over  the  winter  and  spring  of  2013,  teachers 
from  K-5  classrooms  were  recruited  to  participate  in  the  pilot  individually  and  at  the  district  level 
through  the  easyCBM  (http://www.easycbm.com)  and  BRT  websites  (http://www.brtproiects.org 
/about  /current-research),  and  through  existing  research  cooperative  relationships  around  the 
country.  To  protect  confidentiality,  districts,  schools  and  teachers  interested  in  participating 
were  informed  in  writing  that  identifying  information  (e.g.,  demographics)  would  not  be 
collected  on  students  or  teachers,  and  only  information  relevant  to  meeting  research  partnership 
status  would  be  collected  at  the  school  and  district  levels  (e.g.,  the  total  number  of  participating 
students  per  district  or  school).  At  the  same  time,  interested  participants  were  also  given  general 
details  concerning  the  piloting  process,  described  more  specifically  below,  to  make  clear  the 
study  requirements. 

A minimum  of  200  student  responses  per  item  is  desirable  to  obtain  stable  and  accurate 
item  calibrations  using  the  1 -parameter  logistic  Rasch  model  in  a concurrent  equating  design,  as 
was  used  in  the  current  study.  To  fulfill  this  minimum  response  requirement,  we  needed  to 


easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


12 


recruit  3000  students  (15  forms  * 200  responses)  for  each  of  grades  K-5.  We  were,  however, 
constrained  by  the  end  of  the  academic  calendar  and  recruitment  resources,  and  thus,  we  did  not 
meet  the  minimum  desirable  response  requirements  for  each  form  (and  item).  In  total,  7,700 
students  and  329  teachers  from  140  schools,  in  132  districts,  across  33  states  participated  in  the 
piloting  portion  of  the  study  that  began  on  May  15,  2013  and  ended  on  June  15,  2013.  The 
following  number  of  students  participated  in  the  pilot  by  grade:  731  (grade  K),  1,124  (grade  1), 
1,136  (grade  2),  1,685  (grade  3),  1,499  (grade  4)  and  1,525  (grade  5).  Final  pilot  participation 
statistics  by  grade  and  fonn  are  given  in  Table  3. 

Piloting  process.  Once  they  agreed  to  participate,  teachers  were  given  detailed 
instructions  on  how  to  access  the  secure  piloting  website,  how  to  have  their  students  select  the 
appropriate  grade  level  (K-5),  and  how  their  students  would  begin  and  take  the  online  test. 
Students  were  instructed  to  use  scrap  paper  as  necessary,  but  not  to  use  calculators  to  complete 
any  math  items.  Once  students  selected  their  appropriate  grade,  they  were  shown  a title  screen 
that  prompted  them  to  begin  the  test  by  clicking  an  onscreen  button  when  ready.  Students  were 
then  immediately  administered  one  of  15  grade-level  pilot  forms.  The  administered  test  form 
was  automatically  assigned  by  the  piloting  website,  based  on  the  number  of  students  who  had 
completed  that  form  previously.  In  other  words,  students  were  assigned  the  grade-level  pilot 
form  with  the  fewest  number  of  completions  across  all  students  in  the  pilot.  Student  responses 
(a,  b,  or  c)  were  automatically  recorded  in  a secure  online  database  based  on  which  response 
option  a student  selected,  with  the  position  in  which  the  three  answer  options  (a,  b,  or  c)  were 
displayed  on  the  students’  computer  screens  randomized  each  time  an  item  was  administered. 
Given  that  pilot  forms  were  assigned  based  on  the  number  of  times  they  had  been  completed  and 
that  answer  options  were  randomly  rotated  each  time  an  item  was  administered,  cheating  was  a 
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limited  concern.  A screen  capture  of  a fourth  grade  math  item  demonstrative  of  how  all  items 
displayed  on  the  pilot  website  (and  indeed  the  K-8  easyCBM  formative  assessment  system)  is 


shown  in  Figure  1. 


Batting  Averages 


Name 

Average 

Lefty  Louis 

.236 

Slugger  Sue 

.309 

Billy  Bunter 

.217 

Henry  Homer 

.368 

Who  has  the  3rd  highest  average? 


Figure  1.  Screen  capture  of  math  item  illustrating  online  display  of  math  items  in  the  pilot  study 
and  easyCBM  assessment  system. 

Item  calibration.  All  math  items,  including  those  from  the  larger  and  previously- 
existing  NCTM  pool,  were  calibrated  to  the  same  scale  using  a 1-parameter  logistic  (1PL)  Rasch 
model  in  a concurrent  equating  design  using  Winsteps  3.6.8  (Linacre,  2009).  In  the  Rasch 
model,  a special  case  of  the  1 -parameter  logistic  model  in  which  the  item  discrimination 
parameter  is  constrained  to  1.0  and  student  ability  is  freely  estimated  (Linacre,  2008),  all  item 
and  student  parameters  are  estimated  simultaneously  from  a single  data  file  that  contains  all 
student  responses,  grades  K-5.  The  concurrent  equating  design  estimates  student  ability  based 
on  their  responses  to  items,  treating  any  non-responses  as  missing.  Items  are  placed  on  the  same 
scale  through  the  inclusion  of  anchor  items  across  grade  level  forms,  displayed  in  Table  2. 
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The  Rasch  model  is  defined  as 


P(XLS 


H es,pd  = 


exp[(0s-Pj)] 

1 +exp[(9s-Pi)] 


(1) 


where: 

P = probability, 

Xts  = the  response  of  student  s to  math  item  i, 

6S  = the  estimated  ability  of  student  s,  and 

fit  = the  estimated  difficulty  of  math  item  i (DeMars,  2010). 

We  chose  the  more  parsimonious  1PL  Rasch  model  because  it  appears  to  fit  these  data 
well,  and  also  because  we  had  a large  final  item  bank  of  CCSS  math  items  (full  CCSS  item  bank) 
for  grades  K-5,  which  we  analyzed  for  functioning  and  used  to  construct  the  operational 
easyCBM  test  forms.  In  other  words,  we  had  a surplus  of  items  from  which  to  construct  test 
forms,  enabling  us  to  eliminate  those  items  that  did  not  function  well  from  the  full  CCSS  item 
bank. 


Test  form  creation.  Within  each  of  grades  K-5,  we  constructed  13  alternate  test  forms 
designed  to  be  of  comparable  difficulty  (3  to  be  used  as  seasonal  benchmark  screening  tests  and 
10  to  be  used  as  progress  monitoring  tests)  to  make  up  the  CCSS  Math  portion  of  the  easyCBM 
formative  assessment  system.  All  test  forms  consisted  of  items  that  appeared  to  function  well, 
while  counterbalancing  CCSS  domain  representation  within  and  across  each  grade  level  form  as 
possible.  To  construct  the  test  forms,  we  first  eliminated  all  items  from  the  full  CCSS  item  hank 
that  appeared  to  not  fit  the  1PL  Rasch  model  with  regard  to  estimated  mean  square  outfit. 

Wright  and  Linacre  (1994)  simulated  and  analyzed  hundreds  of  datasets,  recommending  that 
mean  square  outfit  values  between  0.5  and  1.5  could  be  interpreted  as  productive  for 
measurement  purposes  for  multiple-choice  test  construction,  with  values  >2.0  considered 
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degrading  to  the  measurement  system.  As  an  initial  step  in  test  form  construction,  we  thus 
eliminated  any  item  from  contention  that  had  mean  square  outfit  smaller  than  0.49  or  greater  than 
1.49. 

After  eliminating  such  items,  within  each  grade  we  sorted  the  remaining  items  in 
ascending  order  by  the  associated  CCSS  domain  and  the  estimated  difficulty  of  items  (easiest  to 
most  difficult).  Within  each  grade,  there  were  either  4 (grades  1 and  2)  or  5 (grades  K,  3-5) 
CCSS  domains  we  attempted  to  counterbalance  within  and  across  test  forms.  Thus,  we 
attempted  to  select  the  same  number  of  items  from  each  CCSS  domain  across  the  13  test  forms  at 
a given  grade  level,  though  this  was  not  possible  in  all  instances,  as  some  CCSS  domains  were 
underrepresented  relative  to  others.  To  accomplish  counterbalancing  CCSS  domain 
representation  while  maintaining  form  comparability,  we  selected  sets  of  13  items  of  roughly 
comparable  difficulty.  We  sought  a range  of  difficulty  between  these  selected  item  sets, 
including  items  with  “reach”  into  the  easier  end  of  the  difficulty  spectrum,  being  cognizant  that 
the  operational  tests  would  be  used  to  assess  diverse  student  populations,  from  both  the  special 
education  and  general  education  populations,  within  an  RTI  framework.  In  terms  of  the  layout 
of  selected  math  items  within  test  forms,  we  clustered  items  within  CCSS  domain,  and  then 
ordered  them  from  easiest  to  most  difficult.  We  reasoned  that  construct-irrelevant  variance 
would  likely  be  lessened  if  students  were  jumping  between  domains  less  often,  and  if  the  math 
skill  requirements  of  problems  “ramped  up”  from  lower-  to  higher-order  within  each  domain. 

The  final  step  in  the  test  fonn  creation  process  was  our  selection  of  horizontal  anchor 
items  between  grade  level  seasonal  benchmarks  to  allow  for  within-year  growth  estimation,  and 
vertical  anchors  between  seasonal  benchmarks  across  grades  as  a basis  for  constructing  a 
developmental  scale  score  after  the  2013-2014  academic  year.  The  same  team  of  four 
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researchers  who  selected  anchors  during  piloting,  selected  anchor  items  for  the  operational  test 
forms  using  the  same  process  and  guidelines  previously  described  because  they  were  intimately 
familiar  with  the  math  items  and  the  item/test  development  process. 

We  selected  horizontal  anchor  items  for  each  benchmark  using  a within- grade  linking 
design.  Within  each  grade,  5 horizontal  anchors  were  selected  to  link  the  fall  and  winter 
benchmarks,  and  5 to  link  the  winter  and  spring;  thus,  each  fall  and  spring  benchmark  test  form 
had  5 horizontal  anchor  items,  while  the  winter  test  had  10.  Horizontal  anchor  items  were 
selected  from  those  items  already  making  up  the  benchmark  tests  at  that  point  in  the  test  form 
creation  process.  At  this  point,  we  had  constructed  13  test  forms  designed  to  be  of  comparable 
difficulty  in  each  of  grades  K-5,  each  test  form  consisting  of  25  (grades  K-2)  or  30  (grades  3-5) 
math  items. 

We  then  selected  vertical  anchor  items  from  the  constructed  test  forms,  adding  5 (grade 
K)  or  10  (grades  1-5)  math  items  to  the  end  of  each  benchmark  test  in  a manner  that  linked 
adjacent  grade  level  benchmarks  of  the  same  season.  For  example,  we  selected  5 first  grade 
math  items  from  the  fall  benchmark  to  add  on  to  the  end  of  the  fall  Kindergarten  benchmark 
(linking  fall  grade  K to  fall  grade  1).  When  a grade  was  adjacent  to  two  other  grades  (i.e.,  grade 
3 is  adjacent  to  both  grades  2 and  4),  additional  vertical  anchors  were  appended  to  the  end  of  the 
seasonal  benchmark  test  forms.  For  example,  the  fourth  grade  fall  benchmark  included  5 vertical 
anchor  items  from  the  third  grade  fall  benchmark  and  5 items  from  the  fifth  grade  fall 
benchmark.  Within  each  test  form,  adjacent  grade-level  vertical  anchor  items  were  ordered  from 
easiest  to  most  difficult  based  on  the  estimated  difficulty  of  each  item  - the  same  manner  in 
which  unique  and  horizontal  anchor  items  were  ordered  with  respect  to  CCSS  domain  - and 
were  appended  to  the  end  of  each  seasonal  benchmark  in  the  order  of  subsequent  and  then  prior 
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grade,  respectively.  This  pattern  of  vertical  anchor  linking  prior  and  adjacent  grades  continued 
for  all  seasonal  benchmarks  for  each  of  grades  K-5  (and  also  grades  6-8,  though  those  results  are 
not  included  in  this  series  of  technical  reports).  Student  responses  to  vertical  anchor  items  over 
the  2013-2014  academic  year  will  serve  as  the  basis  for  constructing  a cross-grade 
developmental  scale  as  we  move  toward  the  reporting  of  a scale  score  in  future  years. 

Results 

As  a result  of  item  development  and  test  creation  efforts  described  in  this  study,  we 
constructed  13  alternate  test  forms:  3 designated  for  seasonal  benchmarking  and  10  designated 
for  progress  monitoring,  in  each  of  grades  K-5.  We  designed  the  test  forms  to  be  aligned  with 
the  CCSS  in  mathematics,  to  be  of  comparable  difficulty  within  grade,  and  to  be  accessible  for 
diverse  student  populations  with  a wide  range  of  achievement.  We  loaded  K-5  tests  into  the 
easyCBM  database  for  use  as  online  formative  CCSS  math  assessments  and  released  them  for 
use  in  fall  2013. 

The  results  of  our  analyses  are  reported  separately  by  grade  (K-5),  each  in  its  own 
technical  report.  For  fourth  grade,  each  seasonal  benchmark  consists  of  40  total  math  items, 
including  5 vertical  anchor  items  linked  to  each  of  the  respective  grade  3 and  grade  5 
benchmarks.  Each  progress-monitoring  test  form  consists  of  30  unique  math  items.  The  item 
difficulties  for  each  of  the  13  fourth  grade  test  forms  are  displayed  in  Table  4. 

Item  Statistics 

We  present  the  results  of  the  1PL  Rasch  analysis  in  ascending  order  by  test  form  and  for 
the  full  CCSS  fourth  grade  item  hank  in  Appendices  B and  D,  respectively.  When  examining 
item  information  in  these  appendices,  it  is  important  to  highlight  two  statistics  critical  to 
evaluating  item  functioning  within  the  context  of  Rasch-based  test  development:  the  estimated 
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difficulty  and  indicator  of  discrimination.  The  difficulty  parameter,  /?,  in  equation  1,  represents 
the  estimation  of  how  difficult  item  i is  relative  to  all  other  items  in  the  analytic  sample,  with 
approximate  possible  values  ranging  from  -3  (easiest  items)  to  +3  (most  difficult  items)  in  the 
standardized  scale  - the  same  scale  on  which  student  ability  (0S)  is  reported  (DeMars,  2010).  An 
estimated  difficulty  equal  to  0 could  then  be  interpreted  as  a student  with  average  ability  would 
have  an  equal  probability  of  getting  the  answer  correct  as  incorrect.  Individual  item  difficulties 
are  averaged  across  forms,  representing  an  average  difficulty  of  each  test  fonn  as  displayed  in 
Table  4,  to  evaluate  form  equivalence.  The  average  difficulty  across  all  13  fourth  grade  test 
forms  is  0.388  (range  = 0.362  to  0.407),  or  slightly  above  average  difficulty. 

The  second  statistic  that  warrants  highlighting  is  the  indicator  of  item  discrimination.  As 
noted  earlier,  the  1PL  Rasch  analysis  constrains  the  discrimination  parameter  to  1.0  (DeMars, 
2010;  Linacre,  2008).  Though  discrimination  statistics  are  included  for  each  item  in  Appendices 
B and  D,  it  is  important  to  distinguish  that  this  item  statistic  is  not  a true  estimation  of  item 
discrimination,  but  rather  an  rough  indicator  of  item  discrimination,  approximated  during  a post- 
hoc  calculation  by  WINSTEPS  (Linacre,  2008).  Interpretation  of  discrimination  values  in  1PL 
Rasch  analysis  is  the  same  as  those  freely  estimated  in,  for  example,  a 2-parameter  logistic 
model;  though,  caution  is  warranted  given  they  are  merely  rough  indicators  in  this  study. 
Discrimination  values  >1.2  are  considered  very  high  (more  productive  for  measurement 
purposes),  while  values  < 0.5  are  considered  very  low,  when  item  difficulty  and  student  ability 
are  estimated  in  the  standardized  scale  (DeMars,  2010),  as  is  the  case  in  our  analysis. 

Distractor  Analysis 

We  present  response  option  statistics  in  ascending  order  by  test  form  and  for  the  full 
CCSS  fourth  grade  item  bank  in  Appendices  C and  E,  respectively.  Interpretation  of  statistics 
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within  these  appendices  is  similar  to  item  level  interpretation,  but  is  presented  for  each  of  the 
three  response  options.  We  coded  the  correct  response  option  as  A for  all  items,  while  the  * 
represents  missing  data  (those  students  included  in  the  analytic  sample  who  did  not  respond  to 
the  given  item  either  by  choice,  if  administered  the  pilot  fonn  containing  the  item,  or  simply 
because  they  were  not  administered  that  form).  We  analyzed  distractors,  seeking  to  retain  well- 
functioning items  in  which  students  with  the  highest  average  estimated  ability  selected  the 
correct  answer  choice,  thus  demonstrating  the  highest  average  person  measure,  while  students 
with  lower  average  estimated  ability  selected  one  of  the  remaining  answer  options.  As  described 
earlier,  we  attempted  to  write  items  with  one  near  distractor  and  one  far  distractor.  Items 
functioning  well  would  thus  demonstrate  near  distractors  with  average  person  measure  values 
slightly  below  that  of  the  correct  response  option  and  far  distractors  with  lower  average  person 
measure  values. 

Discussion 

As  instruction  in  public  schools  across  the  United  States  moves  in  closer  alignment  with 
the  CCSS,  it  is  important  for  formative  student  assessment  to  also  move  in  that  direction  given 
that  the  results  of  such  assessment  are  regularly  used  to  inform  instructional  decision-making 
within  RTI  contexts.  To  a growing  degree,  the  validity  of  instructional  decision-making  in  these 
contexts  depends  on  both  the  alignment  between  adopted  fonnative  assessments  and  the  CCSS 
and  also  the  technical  adequacy  of  such  assessments.  In  this  series  of  technical  reports,  we 
described  the  development  and  scaling  of  the  easyCBM  CCSS  Math  assessments  for  grades  K-5, 
designed  for  use  within  an  RTI  framework  of  instruction  and  formative  assessment  in  elementary 


classrooms. 
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Table  1 


Fourth  Grade  Item  Writing  Plan  by  CCSS  Standard 


CCSS  Standard 

Item  Set  1 

Item  Set  2 

Item  Set  3 

Item  Set  4 

Existing 
BM  Align 

Total 

OA1 

6 

6 

6 

7 

1 

25 

OA2 

3 

3 

2 

2 

5 

10 

OA3 

5 

5 

5 

5 

3 

20 

OA4 

6 

6 

7 

6 

0 

25 

OA5 

5 

5 

5 

5 

3 

20 

NBT1 

4 

4 

4 

3 

1 

15 

NBT2 

4 

3 

4 

4 

1 

15 

NBT3 

4 

4 

3 

4 

1 

15 

NBT4 

5 

5 

5 

5 

0 

20 

NBT5 

4 

4 

3 

4 

3 

15 

NBT6 

5 

5 

5 

5 

0 

20 

NF1 

3 

4 

4 

4 

1 

15 

NF2 

4 

4 

4 

3 

1 

15 

NF3 

4 

3 

4 

4 

1 

15 

NF4 

5 

5 

5 

5 

0 

20 

NF5 

5 

5 

5 

5 

0 

20 

NF6 

0 

0 

0 

0 

8 

0 

NF7 

3 

4 

4 

4 

2 

15 

MD1 

3 

3 

2 

2 

3 

10 

MD2 

0 

0 

0 

0 

16 

0 

MD3 

2 

2 

3 

3 

3 

10 

MD4 

5 

5 

5 

5 

0 

20 

MD5 

5 

5 

5 

5 

0 

20 

MD6 

5 

5 

5 

5 

0 

20 

MD7 

5 

5 

5 

5 

1 

20 

G1 

9 

8 

8 

8 

0 

33 

G2 

8 

8 

8 

9 

0 

33 

G3 

8 

9 

9 

8 

0 

34 

Set  total 

111 

111 

112 

111 

45 

500 

Note.  Item  Sets  1-4  reflect  items  written  to  each  CCSS  standard  based  on  results  from  our 
previous  alignment  study  (Park  et  al.,  2012),  reflected  in  Existing  BM  Align  column.  Total 
represents  the  number  of  math  items  written  to  a given  CCSS  standard  in  the  current  study. 
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Table  2 


Grades  3-5  Piloting  Plan 


Form 

Cl 

C2 

C3 

C4 

C5 

C6 

C7 

C8 

C9 

CIO 

Cll 

C12 

C13 

C14 

C15 

Anchor 

Unique 

Total 

1 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

5 

31 

36 

2 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

3 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

4 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

5 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

6 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

7 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

8 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

9 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

3 

31 

36 

10 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

2 

31 

36 

11 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

3 

31 

36 

12 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

2 

31 

36 

13 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

3 

31 

36 

14 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

2 

31 

36 

15 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

0 

31 

36 

Form 

N1 

N2 

N3 

N4 

N5 

N6 

N7 

N8 

N9 

N10 

Nil 

N12 

N13 

N14 

N15 

Anchor 

Unique 

Total 

1 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

5 

31 

36 

2 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

3 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

4 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

5 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

6 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

7 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

8 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

9 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

2 

31 

36 

10 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

3 

31 

36 

11 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

2 

31 

36 

12 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

3 

31 

36 

13 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

2 

31 

36 

14 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

3 

31 

36 

15 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

0 

31 

36 

Note.  C = CCSS  pool  anchor  item;  N = NCTM  pool  anchor  item.  Anchor  items  appearing  in  a vertical  column  (both  CCSS  or 
NCTM)  were  shared  between  the  specified  forms.  For  example,  fonn  3 and  form  4 shared  3 anchor  items  from  the  CCSS  pool  (set 
C3)  and  2 from  the  NCTM  pool  (set  N3). 
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Table  3 


Grades  K-5  Piloting  Participation  Statistics 


Grade  K 

Grade  1 

Grade  2 

Form 

Completed 

Form 

Completed 

Form 

Completed 

1 

48 

55 

1 

77 

84 

1 

97 

110 

2 

48 

51 

2 

70 

79 

2 

72 

251 

3 

50 

57 

3 

78 

102 

3 

85 

96 

4 

49 

56 

4 

87 

114 

4 

69 

76 

5 

48 

52 

5 

70 

77 

5 

66 

78 

6 

48 

52 

6 

70 

85 

6 

66 

78 

7 

48 

52 

7 

73 

82 

7 

66 

73 

8 

50 

52 

8 

72 

93 

8 

70 

80 

9 

50 

55 

9 

76 

85 

9 

89 

95 

10 

48 

51 

10 

73 

86 

10 

79 

88 

11 

52 

81 

11 

73 

87 

11 

75 

85 

12 

48 

54 

12 

86 

89 

12 

80 

104 

13 

47 

58 

13 

80 

99 

13 

69 

82 

14 

49 

70 

14 

70 

116 

14 

84 

85 

15 

48 

52 

15 

69 

77 

15 

69 

71 

Form  Average 

49 

57 

Form  Average 

75 

90 

Form  Average 

76 

97 

Grade  3 

Grade  4 

Grade  5 

Form 

Completed 

Form 

Completed 

Form 

Completed 

1 

107 

250 

1 

104 

118 

1 

97 

135 

2 

107 

197 

2 

94 

112 

2 

110 

132 

3 

114 

128 

3 

89 

101 

3 

99 

123 

4 

118 

159 

4 

103 

115 

4 

95 

143 

5 

122 

139 

5 

119 

141 

5 

93 

102 

6 

114 

128 

6 

89 

95 

6 

99 

156 

7 

122 

146 

7 

91 

103 

7 

97 

110 

8 

110 

266 

8 

91 

111 

8 

118 

152 

9 

106 

115 

9 

104 

121 

9 

116 

133 

10 

106 

123 

10 

110 

118 

10 

103 

128 

11 

109 

116 

11 

89 

104 

11 

93 

113 

12 

119 

146 

12 

89 

118 

12 

100 

142 

13 

109 

170 

13 

103 

110 

13 

100 

121 

14 

116 

192 

14 

108 

232 

14 

111 

139 

15 

106 

136 

15 

116 

138 

15 

94 

105 

Form  Average 

112 

161 

Form  Average 

100 

122 

Form  Average 

102 

129 

Note.  Many  test  forms  were  started  though  not  completed,  thus,  the  number  of  student  responses  per  item  varies  within  form,  as  shown  in  Appendices  B and  D. 
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Table  4 


Fourth  Grade  Item  Difficulties  by  Test  Form  (without  adjacent  grade  vertical  anchor  items) 


Item  # 

PM1 

PM2 

PM3 

PM4 

PM5 

PM6 

PM7 

PM8 

PM9 

PM  10 

BMF 

BMW 

BMS 

Mean 

1 

-0.48 

-0.39 

-0.36 

-0.35 

-0.33 

-0.32 

-0.32 

-0.31 

-0.22 

-0.20 

-0.41 

-0.41 

-0.41 

-0.347 

2 

0.96 

0.93 

0.91 

0.87 

0.89 

0.90 

0.77 

0.77 

0.82 

0.85 

0.98 

1.01 

1.04 

0.900 

3 

1.63 

1.69 

1.56 

1.75 

1.69 

1.81 

1.66 

1.88 

1.66 

1.88 

1.55 

1.53 

1.53 

1.678 

4 

0.39 

0.41 

0.28 

0.33 

0.49 

0.49 

0.47 

0.37 

0.44 

0.43 

0.45 

0.45 

0.45 

0.419 

5 

0.59 

0.64 

0.64 

0.64 

0.65 

0.66 

0.66 

0.66 

0.69 

0.69 

0.67 

0.67 

0.67 

0.656 

6 

1.20 

1.29 

1.29 

1.31 

1.00 

1.00 

1.11 

1.34 

1.34 

1.37 

1.32 

1.32 

1.32 

1.247 

7 

-0.78 

-0.74 

-0.78 

-0.70 

-0.78 

-0.79 

-0.82 

-0.81 

-0.86 

-0.86 

-0.76 

-0.76 

-0.76 

-0.785 

8 

-0.39 

-0.38 

-0.45 

-0.37 

-0.40 

-0.37 

-0.36 

-0.35 

-0.35 

-0.34 

-0.43 

-0.43 

-0.42 

-0.388 

9 

-0.24 

-0.22 

-0.22 

-0.23 

-0.25 

-0.26 

-0.28 

-0.27 

-0.28 

-0.28 

-0.24 

-0.24 

-0.24 

-0.250 

10 

0.13 

0.13 

0.09 

0.11 

0.12 

0.15 

0.15 

0.16 

0.16 

0.16 

0.14 

0.14 

0.14 

0.137 

11 

0.46 

0.42 

0.44 

0.46 

0.47 

0.45 

0.51 

0.52 

0.42 

0.44 

0.49 

0.49 

0.49 

0.466 

12 

0.71 

0.73 

0.76 

0.76 

0.79 

0.76 

0.77 

0.79 

0.78 

0.80 

0.72 

0.72 

0.72 

0.755 

13 

0.98 

1.00 

1.01 

0.90 

0.88 

0.91 

0.91 

0.94 

0.95 

0.98 

0.88 

0.88 

0.90 

0.932 

14 

1.29 

1.30 

1.30 

1.31 

1.31 

1.32 

1.34 

1.34 

1.36 

1.32 

1.35 

1.35 

1.35 

1.326 

15 

1.51 

1.52 

1.57 

1.59 

1.61 

1.61 

1.54 

1.60 

1.59 

1.60 

1.55 

1.55 

1.55 

1.568 

16 

2.05 

2.02 

2.08 

2.03 

2.06 

2.06 

1.97 

1.97 

2.00 

2.13 

2.10 

2.10 

2.10 

2.052 

17 

2.58 

2.57 

2.56 

2.46 

2.59 

2.68 

2.48 

2.40 

2.59 

2.39 

2.42 

2.42 

2.40 

2.503 

18 

-1.78 

-1.78 

-1.76 

-1.77 

-1.66 

-1.70 

-1.65 

-1.68 

-1.66 

-1.75 

-1.7 

-1.71 

-1.71 

-1.716 

19 

-1.47 

-1.43 

-1.46 

-1.48 

-1.46 

-1.49 

-1.49 

-1.41 

-1.43 

-1.41 

-1.42 

-1.42 

-1.42 

-1.445 

20 

-1.29 

-1.28 

-1.29 

-1.29 

-1.28 

-1.24 

-1.25 

-1.22 

-1.22 

-1.26 

-1.26 

-1.26 

-1.26 

-1.262 

21 

-0.91 

-0.90 

-0.93 

-0.91 

-0.92 

-0.92 

-0.87 

-0.89 

-0.89 

-0.93 

-0.89 

-0.89 

-0.89 

-0.903 

22 

-0.72 

-0.77 

-0.73 

-0.71 

-0.70 

-0.70 

-0.70 

-0.69 

-0.68 

-0.69 

-0.72 

-0.72 

-0.72 

-0.712 

23 

-0.22 

-0.22 

-0.21 

-0.20 

-0.20 

-0.20 

-0.19 

-0.19 

-0.18 

-0.17 

-0.18 

-0.18 

-0.18 

-0.194 

24 

0.12 

0.10 

0.13 

0.10 

0.12 

0.15 

0.13 

0.16 

0.14 

0.15 

0.16 

0.17 

0.17 

0.138 

25 

0.53 

0.54 

0.52 

0.52 

0.52 

0.56 

0.59 

0.59 

0.56 

0.56 

0.55 

0.55 

0.55 

0.549 

26 

0.86 

0.86 

0.85 

0.85 

0.83 

0.89 

0.87 

0.86 

0.89 

0.89 

0.86 

0.86 

0.86 

0.864 

27 

1.76 

1.78 

1.73 

1.74 

1.78 

1.87 

1.79 

1.89 

1.87 

1.86 

1.80 

1.80 

1.80 

1.805 

28 

-0.32 

-0.29 

-0.15 

-0.10 

-0.21 

-0.32 

-0.08 

-0.05 

-0.06 

-0.04 

-0.04 

0.04 

0.04 

-0.122 

29 

0.51 

0.47 

0.53 

0.54 

0.52 

0.40 

0.36 

0.38 

0.35 

0.35 

0.42 

0.41 

0.41 

0.435 

30 

1.19 

1.18 

1.18 

1.30 

1.32 

1.44 

1.46 

1.21 

1.23 

1.29 

1.51 

1.51 

1.52 

1.334 

Mean 

0.362 

0.373 

0.370 

0.382 

0.382 

0.393 

0.384 

0.399 

0.400 

0.407 

0.396 

0.398 

0.400 

0.388 

Note.  PM1  to  PM10  = Progress  Monitoring  Form  1 to  Form  10;  BMF  = Benchmark  Fall,  BMW  = Benchmark  Winter,  BMS  = Benchmark  Spring; 
Green  = horizontal  anchor  items. 
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Appendix  A:  Training 


Appendix  A:  Training  Materials 
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Appendix  A:  Training 


Common  Core  State  Standards  (CCSS) 
Math  Item  Writing  and  Review 

Supplementing  the  easyCBM  math 
assessment  system 


easyCBM 

• easyCBM  is  an  online  benchmark  and  progress 
monitoring  assessment  system. 

• Designed  to  inform  teachers'  classroom-based 
instructional  decisions 

• Used  within  Response  to  Intervention  (RTI) 
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Appendix  A:  Training 


easyCBM  in  Use 

• What  are  your  experiences  with  easyCBM? 

Popularity  of  the  System 

• Registered  users  in  all  50  states 

• Over  2 million  students  in  the  system 

• Over  800,000  teachers  in  the  system 

• Growing  exponentially 

• Over  9000  new  registered  teacher  users  every 
month;  with  district-level  subscribers  growing 


Within  RTI  (very  general) 


Standards,  instruction  and  assessment  must  align 
for  accurate  decision-making  and  inferences! 
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Appendix  A:  Training 


Item 


Before  we  get  too  far: 
Vocabulary 


(Question) 

Stem 


Project  Overview 

• Develop  3,000  new  math  items  for  easyCBM 
in  grades  K-5;  500  items  per  grade 

- Aligned  with  the  Common  Core  State  Standards 
(CCSS) 

- Piloted  in  April/May  to  examine  their  technical 
adequacy  and  establish  difficulty 

— Developed  items  will  be  assembled  with  existing 
items  that  were  aligned  to  CCSS  into  20  test  forms 
per  grade  (60  forms  total). 

- Each  form  will  have  25  items  for  use  in  easyCBM 

- Anticipated  release  date  of  Fall  2013 
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Appendix  A:  Training 


Existing  Items  vs.  Items  to  be  Developed 

Existing  Items 

Items  to  be  Developed 

• Originally  developed  for  the 

• Should  be  developed  for 

2%  population  (i.e., 

students  performing  at  or 

students  performing  well 

slightly  below  grade-level 

below  grade-level 

expectations. 

expectations) 

• Aligned  to  the  NCTM  Focal 
Point  Standards 

• Aligned  to  the  CCSS 

Common  Core  Standards  (see  PDF) 

Grade  K 

Standard  Domains 

• Counting  and  Cardinality  (KCC) 

• Operations  and  Algebraic  Thinking  (KOA) 

• Number  and  Operations  in  Base  Ten  (KNBT) 

• Measurement  and  Data  (KMD) 

• Geometry  (KG) 

24  standards  divided  among  5 domains. 
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Appendix  A:  Training 


Outline  of  GrK  Items  to  be  Written/Reviewed 


Item  Set  2 

Item  Set  3 

Item  Set  4 

Item  Set  5 

CCSS  B M Alien 

Total 

CCl 

5 

5 

6 

6 

0 

22 

CC2 

1 

1 

1 

1 

6 

4 

CC3 

6 

6 

5 

5 

1 

22 

CC4 

1 

1 

1 

1 

5 

4 

CCS 

5 

5 

6 

6 

3 

22 

CC6 

1 

1 

1 

1 

5 

4 

CC7 

6 

6 

5 

5 

2 

22 

SI 

1 

1 

1 

1 

6 

4 

G2 

1 

1 

1 

1 

7 

4 

S3 

10 

10 

11 

11 

2 

42 

G4 

1 

1 

1 

1 

5 

4 

G5 

11 

11 

10 

10 

0 

42 

G6 

1 

1 

1 

1 

8 

4 

MD1 

4 

4 

4 

4 

5 

16 

MD2 

2 

2 

2 

2 

9 

8 

MD3 

19 

19 

19 

19 

4 

76 

NBT1 

25 

25 

25 

25 

1 

100 

DAI 

5 

5 

5 

5 

3 

20 

DA2 

5 

5 

5 

5 

3 

20 

0A3 

5 

5 

5 

5 

0 

20 

OA4 

5 

5 

5 

5 

1 

20 

OA5 

5 

5 

5 

5 

3 

20 

Set  Total 

125 

125 

125 

125 

500 

Common  Core  Standards  (see  PDF) 

Grade  1 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (10A) 

• Number  and  Operations  in  Base  Ten  (1NBT) 

• Measurement  and  Data  (1MD) 

• Geometry  (1G) 


21  standards  divided  among  4 domains. 
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Appendix  A:  Training 


Outline  of  Grl  Items  to  be  Written/Reviewed 


hem  Set  2 

hem  Set  3 

hem  Set  4 

hem  Set  5 

CCSS  B M Alien 

Total 

61 

10 

10 

10 

10 

4 

40 

62 

10 

10 

10 

10 

63 

12 

11 

11 

11 

1 

45 

MD1 

8 

8 

8 

8 

1 

32 

MD2 

8 

8 

8 

8 

0 

32 

MD3 

8 

8 

8 

8 

0 

32 

MM 

7 

7 

7 

8 

3 

29 

NBT2 

1 

2 

1 

1 

5 

5 

NBT3 

10 

10 

10 

10 

2 

40 

NBT3 

10 

10 

10 

10 

0 

40 

NBT6 

10 

10 

10 

10 

0 

40 

OA2 

6 

6 

7 

6 

4 

25 

044 

6 

6 

6 

7 

1 

25 

0A3 

6 

7 

6 

6 

1 

25 

0A7 

6 

6 

7 

6 

0 

25 

0A8 

7 

6 

6 

6 

3 

25 

Set  Total 

125 

125 

125 

125 

500 

Common  Core  Standards  (see  PDF) 

Grade  2 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (20A) 

• Number  and  Operations  in  Base  Ten  (2NBT) 

• Measurement  and  Data  (2MD) 

• Geometry  (2G) 


26  standards  divided  among  4 domains. 
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Appendix  A:  Training 


Outline  of  Gr2  Items  to  be  Written/Reviewed 

hem  Set  2 

Item  Set  3 

Hem  Set  4 

hem  Set  5 

CCSS  BM  Alien 

Total 

si 

10 

10 

11 

11 

0 

42 

G2 

10 

11 

10 

10 

3 

41 

S3 

11 

11 

10 

10 

0 

42 

MD2 

3 

3 

3 

3 

3 

12 

MD3 

4 

3 

4 

4 

0 

15 

MD4 

3 

4 

4 

4 

0 

15 

WD5 

4 

4 

4 

3 

0 

15 

MD6 

3 

3 

3 

4 

2 

13 

>4  07 

3 

3 

3 

3 

3 

12 

MD8 

4 

3 

3 

3 

2 

13 

MD9 

3 

4 

4 

4 

0 

15 

MD10 

4 

4 

4 

3 

0 

15 

NBT2 

5 

5 

5 

5 

0 

20 

•4BT3 

5 

5 

5 

5 

0 

20 

NBT5 

1 

1 

1 

2 

5 

5 

NBT6 

5 

5 

5 

5 

0 

20 

NBT7 

5 

5 

5 

5 

2 

20 

NBT8 

5 

5 

5 

5 

2 

20 

NBT9 

5 

5 

5 

5 

0 

20 

OA1 

2 

1 

1 

1 

7 

5 

QA2 

10 

10 

10 

10 

3 

40 

OA3 

10 

10 

10 

10 

0 

40 

OA4 

10 

10 

10 

10 

1 

40 

125 

125 

125 

125 

500 

Common  Core  Standards  (see  PDF) 

Grade  3 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (30A) 

• Number  and  Operations  in  Base  Ten  (3NBT) 

• Number  and  Operations-Fractions  (3NF) 

• Measurement  and  Data  (3MD) 

• Geometry  (3G) 

25  standards  divided  among  5 domains. 


easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


36 

Appendix  A:  Training 


Outline  of  Gr3  Items  to  be  Written/Reviewed 


Item  Set  2 

Item  Set  3 

Item  Set  4 

Item  Set  5 

CCSS  BM  Alien 

Total 

OAl 

5 

5 

5 

5 

3 

20 

OA4 

5 

5 

5 

5 

4 

20 

OA5 

5 

5 

5 

5 

2 

20 

OA6 

5 

5 

5 

5 

3 

20 

OA8 

5 

5 

5 

5 

3 

20 

NBT1 

8 

9 

9 

8 

0 

34 

NBT2 

9 

8 

8 

8 

0 

33 

NBT3 

8 

8 

8 

9 

1 

33 

NF2 

20 

20 

20 

20 

1 

SO 

NF3 

5 

5 

5 

5 

5 

20 

MD1 

3 

3 

3 

4 

0 

13 

MD2 

4 

3 

3 

3 

0 

13 

MD3 

3 

3 

4 

3 

0 

13 

MD4 

3 

4 

3 

3 

0 

13 

MD5 

3 

3 

3 

3 

0 

12 

MD6 

3 

3 

3 

3 

1 

12 

MD7 

3 

3 

3 

3 

0 

12 

MDfi 

3 

3 

3 

3 

1 

12 

G1 

20 

20 

20 

20 

4 

SO 

62 

5 

5 

5 

5 

15 

20 

125 

125 

125 

125 

500 

Common  Core  Standards  (see  PDF) 

Grade  4 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (40A) 

• Number  and  Operations  in  Base  Ten  (4NBT) 

• Number  and  Operations-Fractions  (4NF) 

• Measurement  and  Data  (4MD) 

• Geometry  (4G) 

28  standards  divided  among  5 domains. 
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Appendix  A:  Training 


Outline  of  Gr4  Items  to  be  Written/Reviewed 


Common  Core  Standards  (see  PDF) 

Grade  5 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (50A) 

• Number  and  Operations  in  Base  Ten  (5NBT) 

• Number  and  Operations-Fractions  (5NF) 

• Measurement  and  Data  (5MD) 

• Geometry  (5G) 

26  standards  divided  among  5 domains. 
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Appendix  A:  Training 


Outline  of  Gr5  Items  to  be  Written/Reviewed 


Item  Set  2 

Hem  Set  3 

Hem  Set  4 

Item  Set  5 

CCSS  BM  Alien 

Total 

OAl 

9 

9 

8 

8 

1 

34 

OA2 

8 

8 

8 

9 

0 

33 

0A3 

8 

8 

9 

8 

0 

33 

NBT1 

3 

4 

4 

4 

2 

15 

NBT2 

4 

4 

4 

3 

2 

15 

NBT3 

5 

5 

5 

5 

0 

20 

NBT4 

4 

3 

4 

4 

2 

15 

NBT5 

5 

5 

5 

5 

0 

20 

NBT6 

4 

4 

3 

4 

3 

15 

NF2 

3 

4 

4 

4 

2 

15 

NF3 

5 

5 

5 

5 

0 

20 

NF4 

4 

4 

4 

3 

1 

15 

KF5 

S 

5 

5 

5 

0 

20 

f»F6 

4 

4 

3 

4 

1 

15 

NF7 

4 

3 

4 

4 

2 

15 

MD1 

7 

7 

8 

8 

0 

30 

M02 

8 

8 

7 

7 

0 

30 

M04 

5 

5 

5 

5 

3 

20 

M05 

S 

5 

5 

5 

4 

20 

G1 

7 

6 

6 

6 

0 

25 

G2 

6 

6 

6 

7 

0 

25 

G3 

6 

6 

7 

6 

0 

25 

G4 

6 

7 

6 

6 

0 

25 

125 

125 

125 

125 

500 

Why  So  Many  New  Items? 

1.  No  matter  how  perfect  an  item  looks,  there 
are  always  quirks. 

- We  need  250-300  "good"  items  per  grade. 

- If  we  write  500  items  per  grade,  we  can  "weed 
out"  the  poor  items. 

2.  The  surplus  of  items  also  allows  us  to 
assemble  items  into  test  forms  (i.e.,  seasonal 
benchmarks  and  progress-monitoring)  of 
comparable  difficulty. 
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Purpose  1 

Example:  Two  Similar  Items 

Item  1 Item  2 


A. 

6 

15 

A.  4 

B. 

8 

p 

B*  18 

C. 

JL 

r, 

C.  1 

Purpose  1 

Example  (continued) 

• Although  the  previous  two  items  look  very 
similar,  our  statistical  analyses  of  the  items 
functioning  indicate  that  Item  1 is  functioning 
quite  well,  while  Item  2 is  functioning  quite 
poorly. 

• Item  2 was  determined  to  be  functioning  poorly 
enough  that  it  was  removed 

• Despite  the  similarities  in  item  construction,  the 
students'  responses  to  the  items  are  very 
different  (i.e.,  matching  student  ability  w/ 
question  difficulty). 
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Appendix  A:  Training 


Purpose  1 
Recap 

Item  1 Item  2 


i*i  = _ 


a.  -Hr  a-  7 

b. {  Good  Item  B -w  Poor  Item 

Why?  It's  difficult  to  say  for  sure,  but  is  part  of  why  we  need  to  write  a 
surplus  of  items 


Purpose  2 
RTI 

• RTI  requires  multiple  test  forms  of  equivalent 
difficulty 

• If  forms  are  not  equivalently  difficult, 
assumptions  about  the  growth  students  make 
and/or  the  effectiveness  of  instruction  or  an 
intervention  may  not  be  accurate 
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Appendix  A:  Training 


Purpose  2 
(Continued) 

• Growth? 

- What  if  first  three 
forms  were  unusually 
difficult  and  the  last 
two  forms  were 
unusually  easy? 

• We  need  to  have  a sufficient  number  of  items 
to  ensure  that  forms  actually  are,  statistically 
speaking,  equivalently  difficult. 


G*«d«  1.  Wo  id  H« ini|  FluMicy:  Jufa  Aton?® 


(•M  Grea* 

£ ifl 

.u,_ • 

• 

sa  - 

/ / s 

D«ta  of  AnainiliHtM 

Or»il  30  nvuimr  on  awcutor 


10PB  • '30PB  SOpb  90p* 


Your  Role  As  the  Item  Writer  and 
Item  Reviewer 

A Concurrent  Process  of  Item 
Writing , Reviewing , and  Submission 
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Appendix  A:  Training 


Your  role  as  the  Item  Writer 

• Become  an  "item  writing  expert" 

- Thoroughly  review  the  CCSS  associated  with  the 
grade-band  you  have  been  assigned  (i.e.,  K-l,  2-3, 
and  4-5). 

- Review  "example  items"  in  ItemSet  spreadsheet. 

• Complete  two  ItemSet  spreadsheets, 
consisting  of  125  items  for  each  grade  of  your 
assigned  grade  band  (i.e.,  125  grade  K items, 
and  125  grade  1 items  for  K-l  grade  band) 

• Thoroughly  review  all  items  written  before 
turning  items  in  to  BRT  (in  batches). 


Your  role  as  the  Item  Reviewer 

• Become  an  "item  writing  expert" 

- Thoroughly  review  the  CCSS  associated  with  the 
grade  that  you  have  been  assigned  (i.e.,  K,  1,  2,  3, 
4,  or  5). 

- Review  "example  items"  in  ItemSet  spreadsheet. 

• Review  and  edit  500  grade-level  items  from 
the  4 ItemSets  (in  batches). 

• Thoroughly  review  all  items  written  before 
turning  items  in  to  BRT  (in  batches,  by 
ItemSet). 
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Excel  ItemSet  Template  cont. 

• Each  ItemSet  consists  of  125  items 

• Item  Writers  will  write  all  125  items  and  fill  out  the 
excel  sheet. 

- After  writing  items  into  the  excel  file,  the  Item  Writer 
should  add  an  underscore  and  their  initials  after  the 
version  number  to  save  it 

• e.g.,  Item  Writer  = Shawn  Irvin: 

G2ltemSet2.xlsx  G2ltemSet2_Sl.xlsx 

• Each  Item  Writer  will  write  items  to  specific  CCSS, 
most  times  multiple  items  per  standard 

• The  number  of  items  per  domain  will  vary  by  Item 
Writer  and  grade. 


Excel  ItemSet  Template 


•rtnv  ■■«!*  f"*  (Mfr  i* r*«i  i*  id'r  ?frtr 


.. Kli-iv1  IhiKi"  Hhtn1  MMn  Mlfim'  ***.*?,  V !! 


emt  •»«»  j wtn»r  o. 


Sir- 


Write  one  Question  (stem)  and  three 

Answer  options  in  these  cells 

• Option  A is  always  the  correct 
answer 

• Options  B and  C are  always 
incorrect,  but  plausible  distractor 
responses 


The  "home"  for  all  of  the  items  we  write  and  review!!! 
These  ItemSet  spreadsheets  will  be  passed  from  Writers  to 
me  to  Reviewers  and  back  to  me  for  an  in-house  review. 
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Appendix  A:  Training 


Item  ID  Naming  Convention 

• It  is  crucial  that  all  items  written  are  filled  out 
in  the  excel  sheet  appropriately 

• Graphics  accompanying  an  item  MUST  BE 
given  the  same  ID  because  the  graphic  is  part 
of  the  item. 

- If  the  wrong  ID  is  assigned  to  the  graphic,  it  will 
either  be  lost  or  accompany  the  wrong  item. 
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Graphics  (images)  in  Items 

• First  rule  of  graphics  - they  are  expensive 

- Adds,  on  average,  around  $50  to  the  total  cost  of  the 
item 

• Does  this  mean  graphics  should  not  be  used? 

- No,  but  it  does  mean  that  graphics  should  only  be  used  if 
they  (a)  increase  the  clarity  of  the  item  or  (b)  are 
essential  to  the  content  of  the  item  (i.e.,  in  geometry) 

- Graphics  may  be  necessary  for  some  standards! 

• There  is  also  no  clear  research  on  the  effect  of 
adding  a graphic  to  an  item  (Kettler,  Elliott,  & 
Beddow,  2009) 


Graphics  in  Items  (cont.) 

• Graphics  can  be  in  question/stem,  and/or  in 
answer  options! 

• If  you  as  an  Item  Writer  or  Reviewer  want  to 
add  graphics,  they  have  two  options: 

1.  Describe  what  the  graphic  will  look  like  in  detail  in 
the  excel  sheet  (recommended  if  the  graphic  is 
simplistic). 

2.  Draw  the  graphic  by  hand  or  use  clipart  from  the 
web  in  the  "Graphics  Template"  provided. 
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Describe  what  the  graphic  will  look  like  in 
detail  in  the  excel  sheet  (recommended  if  the 
graphic  is  simplistic). 

tW«Ttax  >«»•••«■<  P >»«?»•«*'  *i  If**. 

4>mBE5  ftjwagpna  ‘V^inJTTr^ 

M!>  M • 

!C<  i 

»r*»  '*■'» 

*«ra  niMn  mo  » i 

iMunMHtaatnM-  r.rM  « J • rM  'iMn  ll 

otoo 

u**» 

Norbi  r<  •••*'* 

, !»■  r i»— » w »»■ 

nbM 

Protocol  for  Hand  Drawn  Graphics 


• Draw  the  graphic  by  hand  using  "Graphic  Template" 

• Matching  Item  ID  exactly! 


jgmeir^  l tyl  \y- 


J U 


llom_  3 Of 5 & P"9 


© isms  El 
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Protocol  for  Hand  Drawn  Graphics 
(as  it  is  seen  in  easyCBM) 


The  head  is  a 


A.  wangle 

B.  circle 

C.  square 


Protocol  for  Hand  Drawn  Graphics 

• Use  clipart  from  the  web  and  enter  into  "Graphics 
Template" 

http://www.fotosearch.com/ 


Note.  We  will  not  use  any  of  the  clipart  in  the  actual  items, 
but  it  is  a way  to  communicate  approximately  what  the 
graphic  should  look  like. 
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Use  Basic  Codes  in  ItemSet  Spreadsheets 

(see  ExampleSheet  K-5CCSS.docx  for  more) 

• Image:  [img]item_7NS3008.png[/img] 

• Division  symbol:  Bt4  = 3[divide]4  = 3[div]4 

• Long  division:  3[longdiv]42[/longdiv] 

• Square  roots:  V25  = [squareroot]25[/ 
squareroot] 

• Pi:  Jt  = [pi] 

• Vertically  stacked  add/sub/multiply: 

[plus]30:40:12[/plus]  30 

40 
+ 12 


Excel  Sheet  (see  Example  Problems) 
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The  Basic  Process 

Item  Writers: 

• You  will  write  and  turn  items  in  batches, 
approximately  ~20-40  items  at  a time,  and  email 
them  to  me  for  a quick  check  for  completeness 
and  quality,  with  all  250  items,  two  completed 
ItemSet  spreadsheets  due  by  Friday,  January  11th, 
2013. 

• I will  email  OKd  items  to  Item  Reviewers. 

• Item  Reviewers  will  individually  be  reviewing, 
editing  aj[  items  for  ways  to  improve  them,  and 
returning  them  to  me,  but  they  should  be  a 
strong  as  you  can  get  them  before  emailing  them 
to  me. 


The  Basic  Process  (cont.) 

Item  Reviewers: 

• After  you  have  reviewed/edited  all  items  in  an 
item  set  and  deemed  them  to  be  (a)  aligned  to 
the  standard,  (b)  mathematically  accurate,  (c) 
grade-level  appropriate,  (d)  free  of  bias,  and  (e) 
"good"  overall  items,  you  turn  in  the  ItemSet 
spreadsheet  to  me  at  BRT. 

• Email  items  back  to  me  in  batches,  a full  ItemSet 
(i.e.,  125  group  of  grade-level  items  from  a single 
Item  Writer)  at  a time  ->  you  will  turn  in  a total 
of  four  of  these  for  your  grade,  with  all  ItemSets 
due  by  Friday,  January  25th,  2013 
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Deadlines  and  Compensation 

• Compensation  will  be  released  upon  completion 
of  your  work,  pending  approval  by  BRT  and  the 
University  of  Oregon  (me) 

• $800  for  Item  Writers  completing  two  ItemSets 
of  125  items  each,  250  total  ->  January,  11th, 
2013 

• $1500  for  Item  Reviewers  for  reviewing/editing 
500  grade-level  math  items  ->  January,  25th, 
2013 


Study-related  or 
Procedural 
QUESTIONS? 
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Some  Basic  Item  Writing 
Guidelines 
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Why  multiple 

choice  items? 

“Selected-response  items  are  the  most  appropriate  item 

format  for  measuring  cognitive  achievement  or  ability, 

especially  higher  order  cognitive  achievement  or  cognitive 

abilities,  such  as  problem  solving,  synthesis,  and 

evaluation.”  (Downing,  2006,  p.  288) 

• Validity 

• Efficiency 

— Less  chance  of 

— Easy  to  administer 

construct  irrelevant 

— Easy  to  produce 

variance  in  scores 

— Easy  to  score 

— Allow  a given  skill 

objectively  (as 

to  be  assessed 

opposed  to 
constructed 

multiple  times 

response  item 

(multiple  items) 

types) 

How  do  you  write  a good  item? 

Art  or  SCIENCE?  (maybe  a little  of  both) 


Answer  Options: 

• Use  only  3 options:  1 
correct  response  and  2 
distracters 

• Choose  logical  distracters 

• Avoid  excess  text  or 
irrelevant  features 


Assess  Only  Target  Knowledge: 

• Targeting  Math 

• Reduce  language  as  much  as 
possible 

• If  the  item  is  supposed  to 
assess  fractions,  make  sure  it 
doesn't  assess  other  factors, 
such  as  conversions  or 
estimations. 

Be  Sensitive  of  Bias  Issues: 

• Keep  in  mind  the  population  of 
students  who  will  be  taking  the 
items 

• Consider  ELL,  SWD,  diverse 
cultures,  etc. 
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Universal  Design 

How  should  we  design  a building  so  the  widest  range 
of  populations  possible  can  access  it? 


Universal  Design  for  Assessment 


• Considers  all  characteristics  of  test-takers. 

• Precisely  defined  constructs. 

• Accessible,  non-biased  items. 

•"  Items  amendable  foaccommodanonsl  j 

• Simple,  clear,  and  intuitive  instructions  and  j 

procedures.  I 


Maximum  readability  and  comprehensibility. 

Maximum  legibility  of  text,  tables,  figures,  and 
illustrations 


Thompson,  Johnstone,  and  Thurlow  (2002) 


easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


55 

Appendix  A:  Training 


TABLE  1 

A Revised  Taxonomy  of  Multiple-Choice  (MC)  hem- Writing  Guidelines 


Content  concerns 

1.  Every  item  should  reflect  specific  content  and  a single  specific  menial  behavior,  as  called  for  in 
test  specifications  (two-way  grid,  test  blueprint). 

2.  Base  each  item  on  important  content  to  learn:  avoid  trivial  conlenL 

3.  Use  novel  material  to  test  higher  level  learning.  Paraphrase  textbook  language  or  language  used 
during  instruction  when  used  in  a test  item  to  avoid  testing  for  simply  recall. 

4.  Keep  the  content  of  each  item  independent  from  content  of  other  items  on  the  tesL 

5.  Avoid  over  specific  and  over  general  content  when  writing  MC  items. 

6.  Avoid  opinion-based  items. 

7.  Avoid  trick  items. 

8.  Keep  vocabulary  simple  for  the  group  of  students  being  tested. 

Formatting  concerns 

9.  Use  the  question,  completion,  and  best  answer  versions  of  the  conventional  MC,  the  alternate 
choice,  true-false  (TF).  multiple  true-false  (MTF).  matching,  and  the  context-dependent  item 
and  item  set  formats,  but  AVOID  the  complex  MC  (Type  K)  format. 

10.  Format  the  item  vertically  instead  of  horizontally. 

Style  concerns 

1 1.  Edit  and  proof  items. 

12.  Use  correct  grammar,  punctuation,  capitalization,  and  spelling. 

13.  Minimize  the  amount  of  reading  in  each  item. 

Writing  the  stem 

14.  Ensure  that  the  directions  in  the  stem  are  very  clear. 

15.  Include  the  central  idea  in  the  stem  instead  of  the  choices. 

16.  Avoid  window  dressing  (excessive  verbiage). 

17.  Word  the  stem  positively,  avoid  negatives  such  as  NOT  or  EXCEPT.  If  negative  words  are  used, 
use  the  word  cautiously  and  always  ensure  that  the  word  appears  capitalized  and  boldface. 


TABLE  1 

A Revised  Taxonomy  of  Multiple-Choice  (MC)  Hem-Writing  Guidelines 


Writing  the  choices 

18.  Develop  as  many  effective  choices  as  you  can.  but  research  suggests  three  is  adequate. 

19.  Make  sure  that  only  one  of  these  choices  is  the  right  answer. 

20.  Vary  the  location  of  the  right  answer  according  to  the  number  of  choices. 

21 . Place  choices  in  logical  or  numerical  order. 

22.  Keep  choices  independent:  choices  should  not  be  overlapping. 

23.  Keep  choices  homogeneous  in  content  and  grammatical  structure. 

24.  Keep  the  length  of  choices  about  equal. 

25.  None-of-lhe-uboxe  should  be  used  carefully. 

26.  Avoid  All-of-the -above. 

27.  Phrase  choices  positively:  avoid  negatives  such  as  NOT. 

28.  Avoid  giving  clues  to  the  right  answer,  such  as 

a.  Specific  determiners  including  always,  never,  completely,  and  absolutely. 

b.  Clang  associations,  choices  identical  to  or  resembling  words  in  the  stem. 

c.  Grammatical  inconsistencies  that  cue  the  test-taker  to  the  correct  choice. 

d.  Conspicuous  correct  choice. 

e.  Pairs  or  triplets  of  options  that  clue  the  test-taker  to  the  correct  choice. 

f.  Blatantly  absurd,  ridiculous  options. 

29.  Make  all  distractors  plausible. 

30.  Use  typical  errors  of  students  to  write  your  distractors. 

31.  Use  humor  if  it  is  compatible  with  the  teacher  and  the  learning  environment. 


Haladyna,  2002,  p.  312 
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Content  Concerns 

“Every  item  should  reflect  specific  content  and  a single 
specific  cognitive  process”  (Haladyna,  2004,  p.  98). 

Guidelines 

• Write/review  items  that  align  with  only  one  standard 
(or  one  part  of  one  standard),  and  that  the  item 
targets  that  standard  clearly  and  directly. 

— Target  only  one  skill  in  each  item.  If  standard  asks  for 
multiple  skills,  use  multiple  items. 

• Try  not  to  be  over-specific  or  over-general. 

• Try  not  to  "trick  the  students" 

• Each  item  should  be  independent  of  all  others. 

• Avoid  focusing  items  on  trivial  parts  of  standards. 

• Present  items  in  novel  formats 

Note.  The  following  slides  are  largely  based  on  Haladyna,  2004. 


Targeting  Only  One  Skill 

Standard  6.SP:  Recognize  that  a measure  of  center  for  a numerical  data  set  summarizes  all  of 
its  values  with  a single  number,  while  a measure  of  variation  describes  how  its  values  vary  with 

a single  number. 

Example  item  1 

Example  item  2 

Which  number 

Which  number 

describes  the  center  of 

describes  the  center  of 

the  dataset? 

the  dataset? 

Dataset:  5,  7,  3,  3 

Dataset:  5,  7,  3,  3 

A)  Average  -4.50 

A)  4.50 

B)  Standard  deviation  - 1.91 

B)  1.91 

C)  Range -4.00 

C)  4.00 
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Targeting  Only  One  Skill 

Example  item  1 

Example  item  2 

• The  first  item  provides  the 

• Second  item  requires 

student  with  the  name  of 

student  to  both  know  the 

the  statistic  AND  the 

best  statistic  (average)  AND 

number. 

to  recognize  which  number 

• The  target  skill  of  the  item 
(measure  of  central 

represents  that  statistic. 

tendency)  is  not  confused 

• Item  has  less  text,  but  in 

with  other  math  skills. 

this  case,  the  text  may  help 

HOWEVER - 
• Item  still  requires 

vocabulary  and  additional 
reading  skills  over  a simpler 
version 

target  the  skill  of  interest. 

Targeting  Only  One  Skill 

• Both  items  target  only  one  part  of  the 
standard  (central  tendency),  yet  item  2 still 
targets  multiple  math  skills. 

— Note:  if  we  were  interested  in  knowing  students' 
skills  with  calculating  the  average,  we  could  easily 
address  it  with  a different  item. 

Example 

The  average  of:  4,  3,  9,  4 = ? 

- A)  5 

- B)  20 
-C)4 
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Over-specific/Over-general 

Over-specific  item 

Over-general  item 

Who  wrote  the  Icon  of  Seville? 

Which  is  the  most  serious 

A)  Lorca 

problem  in  the  world? 

B)  Ibanez 

A)  hunger 

C)  Rodriguez 

B)  lack  of  education 

C)  disease 

Over-specific  items  often  assess 

Over-general  items  are  often 

trivial  content. 

opinion-based. 

Balancing  the  generality  of  an  item  is 

part  of  the  "art"  of  writing  good  items. 

Note.  Examples  from  Haladyna,  2004,  p.  102. 

Trick  Questions 

• Is  there  a fourth  of  July  in  England? 

Yes,  there  is  a fourth  of  July  everywhere. 

• Some  months  have  31  days.  How  many  have 
28? 

All  of  them 

• How  many  animals  of  each  gender  did  Moses 
bring  on  his  ship? 

None.  Moses  didn't  have  a ship,  Noah  did. 

• A butcher  in  the  meat  market  is  six  feet  tall. 
What  does  he  weigh? 

Meat 

Note.  Examples  from  Haladyna,  2004,  p.  104. 
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Trick  Questions 

“There  are  enough  problems  in  testing 
without  contributing  more  by  using  trick 
items.”  (Haladyna,  2004,  p.  104) 


Formatting  Concerns 

• Make  sure  stem  is  a complete  sentence/ 
directive. 

• Make  sure  item  is  multiple  choice,  and 
contains  three  options  (correct  response  and 
two  plausible  distracters). 

• Correct  response  is  always  answer  Option  A 

— Because  items  will  be  computer-administered,  we 
will  randomly  rotate  all  options.  For  development 
purposes,  it's  easiest  to  always  keep  the  correct 
response  in  a consistent  location. 

All  other  formatting  concerns  are  BRT  responsibility 
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Style  Concerns 

• Please  proof  read  all  items  you  wrote  before  you 
turn  them  over  to  me  (both  Writers  and 
Reviewers) 

• Primary  things  to  look  for: 

— Grammar 

- Can  the  reading  load  be  reduced  without  losing 
clarity? 

— Is  there  more  than  one  construct/skill? 

— Bias  and  sensitivity  (i.e.,  variety  of  diverse  names  - 
Google  them!) 


Stem  Construction 

• Try  to  be  as  clear  and  concise  as  possible 

• Make  sure  the  stem  is  complete  and  contains 
all  the  information  needed  to  solve  the 
problem. 
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Developing  Options  (correct  option 
and  two  plausible  distractors) 

• Probably  the  most  difficult  part  of  an  item  to 
develop. 

• Answer  options  must  be  reasonable  and  have 
only  one  justifiably  correct  answer  (e.g.,  if  you 
can  make  a reasonable  argument  that  one  of 
the  distracters  is  also  correct,  it  is  not  a good 
distracter). 

• You're  an  expert!!!  Think  about  the  common 
math  mistakes  your  students  make! 


Developing  Options  (cont.) 

In  a perfectly  functioning  item... 

• Stem  contains  all  the  information  needed  to 
solve  the  question 

— Answer  option  A is  the  correct  response,  and  will  be 
chosen  by  students  who  understand  the  content 
targeted  by  the  item. 

— Answer  option  B is  a close  distracter,  and  will  be 
chosen  by  students  who  have  partial,  but  incomplete 
knowledge  of  the  content  targeted  by  the  item. 

— Answer  option  C is  a far  distracter  (but  not  TOO  far), 
and  will  be  chosen  by  students  who  have  little  to  no 
knowledge  of  the  content  targeted  by  the  item. 
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Developing  Options  (cont.) 

• Keep  format  of  each  option  the  same  (length, 
grammar,  etc.) 

• Do  not  use  "all  of  the  above"  or  "none  of  the 
above" 

• Keep  distracters  plausible,  but  avoid  hinting  at 
the  correct  response. 

• Try  to  use  distracters  that  represent  typical 
student  errors 


Developing  Options  (cont.) 

• Although  guidelines  can  help,  coming  up  with 
reasonable  options  is  difficult.  Getting  the 
options  to  all  function  the  way  they  are 
intended  to  is  even  more  difficult. 

— Why  some  refer  to  item  writing  as  an  art  (as 
opposed  to  a science)  it's  a little  of  both 
though! 
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Hypothetical  Example 

• Imagine  a kindergarten  or  first  grade  standard 
that  requires  students  have  knowledge  of 
basic  geometric  shapes  - faces,  sides,  angles, 
etc. 

— i.e.,  squares,  circles,  triangles,  rectangles,  etc. 


Item  Non-Example 

Greg  and  Sally  were  both  in  the  first  grade.  Greg 
liked  the  color  blue  and  always  wore  a blue  shirt. 
Sally  liked  the  color  green  and  always  wore  a 
green  shirt.  Which  shirt  has  more  triangles  on 
it? 


a)  blue  c)  Sally  e)  triangles 

b)  green  d)  Greg 
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Why  this  is  a poor  item 

• Way  too  much  text 

• Lots  of  irrelevant  information 

• Low-cognitive-level  question  (basically  counting  - 
though  some  standards  this  skill  is  targeted) 

• What  if  the  student  is  color  blind? 

• Too  many  options 

- Not  logical  distracters 

— There  is  arguably  more  than  one  correct  response 
option  (either  blue  or  Greg) 

• Doesn't  really  address  the  standard 


Item  non-example  2 

Triangles: 

a)  have  three  sides 

b)  have  two  long  sides  and  two  short  sides 

c)  have  rounded  edges 

d)  all  of  the  above 

e)  none  of  the  above 
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Why  this  is  a poor  item 

• Stem  does  not  present  the  information 
needed  solve  the  problem. 

• Uses  the  "all  of  the  above"  and  "none  of  the 
above"  options 

— Although  there  is  some  empirical  evidence 
supporting  that  the  "all  of  the  above"  option 
increases  the  difficulty  (Huang,  Trevisan,  & 
Storfer,  2007),  the  general  consensus  is  that  it 
creates  a "cueing"  effect  for  students.  Also, 
students  may  choose  these  options  with  mis-  or 
partial  knowledge. 
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Why  is  this  a better  item? 

• Clearly  addresses  the  standard 

• Low  level  of  text 

• No  irrelevant  information 


Language  Issues 


For  math  items,  excess  text  threatens  validity 

- Particularly  worrisome  for  English  language 
learners  (ELL) 


What  to  do? 


— Use  familiar,  grade- 
level  appropriate 
words 

— Omit  all  unnecessary 
words 

— Use  no  text  if  possible, 
or  keep  sentences  as 
brief  as  possible 


— Avoid  conditional 
and  relative  clauses 

— Avoid  negation 

— Use  concrete 
versus  abstract 
representation 
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Now....  Time  to  look  at  some  real  items! 

Existing  easyCBM  items 


Existing  easyCBM  items 

• Note.  There's  only  a limited  amount  we  can 
learn  from  these  items 

— Aligned  to  different  standards 
— Developed  for  a different  population 

However 

• Formatting  will  be  similar 

• Universal  design  features  evident 

• Good  item  writing  principles  applied 

• Perhaps  most  important  - We  know  they  work! 


easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


68 

Appendix  A:  Training 


Existing  easyCBM  item 

Standard:  Solve  problems  about  similar  objects  (including  figures)  by  using  scale 
factors  that  relate  corresponding  lengths  of  the  objects  or  by  using  the  fact  that 
relationships  of  lengths  within  an  object  are  preserved  in  similar  objects. 

• Universal  Design  features? 

• Targets  a single  skill? 

• Over-specific/over-general? 

• Clear  and  concise? 

• Alignment? 

• Other  concerns? 

a.  \ in.  Remember:  These  items  were  designed  for  very  low 

b.  4 in.  performing  students.  The  new  items  should  target 

c.  5 in.  students  at  or  slightly  below  grade-level  expectations. 


Existing  easyCBM  item 

Standard:  Use  descriptive  statistics,  including  mean,  median,  and  range,  to  summarize 
and  compare  data  sets. 


B.  $9 

C.  $12 


• Universal  Design  features? 

• Targets  a single  skill? 

• Over-specific/over-general? 

• Clear  and  concise? 

• Alignment? 

• Other  concerns? 
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One  more... 

Standard:  Explain  why  the  sum  of  the  measures  of  the  angles  in  a triangle  is  180 
degrees,  and  they  apply  this  fact  about  triangles  to  find  unknown  measures  of  angles. 

• Universal  Design  features? 

• Targets  a single  skill? 

• Over-specific/over-general? 

• Clear  and  concise? 

• Alignment? 

• Other  concerns? 

A.  38° 

B.  71° 

C.  16° 


How  do  you  become  a good  item  writer? 

“Effective  item  writers  are  trained,  not 
born...  Although  item  writers  must  be 
expert  in  their  own  disciplines,  there  is  no 
reason  to  believe  that  their  subject  matter 
expertise  generalizes  to  effective  item 
writing  expertise.” 

(Downing,  2006,  p.  11) 
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Appendix  A:  Training 


Bottom  line 

“Practice  does  not  make  perfect.  Only 
perfect  practice  makes  perfect.” 
-Vince  Lombardi 

• Practice,  practice,  practice. 

- Practice  writing  different  types  of  items 

• Geometry,  number  & operation,  etc. 

- Look  back  at  other  test  items 

• Find  examples  of  good  and  bad  items 


Resources 

• Multiple  choice  item  writing  Do's  and  Don'ts 

— http://www.eric.ed.gov/PDFS/ED398238.pdf 

• Recommendations  portion  of  the  following 
IDEA  paper 

- http://www.theideacenter.org/IDEAPaperl6 

Plenty  more  resources  online  can  be  found  with 
a quick  Google  search. 
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Appendix  B:  Item  Statistics  by  Test  Form 
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easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


72 

Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

1 

1 

40A52 

-0.48 

89 

79 

0.35 

0.92 

-0.26 

0.62 

-0.93 

0.36 

1.10 

1 

2 

40A47 

0.96 

104 

58 

0.22 

0.97 

-0.39 

0.91 

-0.79 

0.46 

1.13 

1 

3 

40A113 

1.63 

121 

52 

0.20 

1.19 

2.46 

1.28 

2.76 

0.16 

0.33 

1 

4 

4NBT47 

0.39 

109 

81 

0.24 

0.95 

-0.38 

0.80 

-0.87 

0.42 

1.12 

1 

5 

4NBT419 

0.59 

94 

64 

0.24 

0.84 

-1.76 

0.74 

-1.60 

0.52 

1.41 

1 

6 

4NBT42 

1.20 

91 

52 

0.23 

0.91 

-1.23 

0.85 

-1.26 

0.47 

1.37 

1 

7 

4NF520 

-0.78 

104 

88 

0.29 

0.92 

-0.38 

0.87 

-0.34 

0.38 

1.07 

1 

8 

4NF710 

-0.39 

92 

77 

0.29 

0.84 

-0.92 

0.62 

-1.29 

0.46 

1.20 

1 

9 

40685 

-0.24 

63 

46 

0.31 

1.14 

0.95 

1.18 

0.63 

0.27 

0.75 

1 

10 

4NF417 

0.13 

90 

62 

0.24 

0.93 

-0.74 

0.82 

-0.94 

0.42 

1.21 

1 

11 

40056 

0.46 

49 

27 

0.32 

1.09 

0.74 

1.04 

0.25 

0.35 

0.78 

1 

12 

4NF71 

0.71 

89 

51 

0.23 

0.96 

-0.47 

1.11 

0.87 

0.39 

1.06 

1 

13 

40206 

0.98 

53 

23 

0.31 

1.13 

1.06 

1.30 

1.20 

0.35 

0.59 

1 

14 

4NF41 

1.29 

104 

51 

0.22 

1.26 

3.05 

1.39 

3.25 

0.16 

0.14 

1 

15 

4NF412 

1.51 

105 

55 

0.21 

1.31 

3.95 

1.37 

3.17 

0.13 

-0.17 

1 

16 

40683 

2.05 

55 

17 

0.34 

0.95 

-0.26 

1.44 

1.39 

0.46 

0.97 

1 

17 

40216 

2.58 

56 

10 

0.41 

0.97 

-0.05 

0.78 

-0.23 

0.53 

1.05 

1 

18 

40570 

-1.78 

60 

54 

0.44 

0.98 

0.03 

0.71 

-0.31 

0.28 

1.04 

1 

19 

40565 

-1.47 

62 

54 

0.40 

0.99 

0.05 

1.13 

0.41 

0.26 

0.97 

1 

20 

41045 

-1.29 

71 

60 

0.36 

0.92 

-0.30 

0.64 

-0.80 

0.47 

1.12 

1 

21 

40189 

-0.91 

56 

44 

0.36 

0.70 

-1.59 

0.52 

-1.35 

0.57 

1.39 

1 

22 

40463 

-0.72 

55 

43 

0.35 

0.89 

-0.57 

0.71 

-0.52 

0.41 

1.19 

1 

23 

41052 

-0.22 

59 

39 

0.31 

0.89 

-0.74 

0.85 

-0.47 

0.51 

1.20 

1 

24 

40886 

0.12 

55 

35 

0.31 

0.87 

-1.02 

0.77 

-1.09 

0.54 

1.34 

1 

25 

40294 

0.53 

56 

31 

0.30 

1.24 

1.95 

1.50 

2.24 

0.24 

0.26 

1 

26 

4MD67 

0.86 

104 

60 

0.22 

1.18 

2.08 

1.24 

1.91 

0.24 

0.48 

1 

27 

40409 

1.76 

64 

21 

0.30 

0.91 

-0.64 

1.04 

0.23 

0.47 

1.14 

1 

28 

4G319 

-0.32 

92 

75 

0.28 

0.96 

-0.21 

0.82 

-0.64 

0.31 

1.07 

1 

29 

4G112 

0.51 

94 

66 

0.24 

1.10 

0.92 

1.06 

0.37 

0.28 

0.82 

1 

30 

4G129 

1.19 

92 

53 

0.23 

1.18 

2.11 

1.28 

2.07 

0.19 

0.33 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

2 

1 

40  A3  8 

-0.39 

90 

70 

0.27 

1.05 

0.41 

0.97 

-0.05 

0.26 

0.94 

2 

2 

40A316 

0.93 

91 

54 

0.23 

0.82 

-2.47 

0.75 

-2.28 

0.54 

1.67 

2 

3 

40A48 

1.69 

109 

54 

0.21 

1.15 

1.88 

1.17 

1.41 

0.30 

0.54 

2 

4 

4NBT51 

0.41 

95 

66 

0.24 

0.82 

-1.85 

0.71 

-1.56 

0.53 

1.41 

2 

5 

4NBT113 

0.64 

122 

78 

0.20 

1.02 

0.31 

1.03 

0.27 

0.35 

0.94 

2 

6 

40778 

1.29 

54 

21 

0.32 

0.84 

-1.23 

0.75 

-1.14 

0.58 

1.37 

2 

7 

4NF511 

-0.74 

103 

92 

0.33 

0.86 

-0.54 

0.56 

-1.06 

0.40 

1.14 

2 

8 

40224 

-0.38 

278 

225 

0.16 

1.04 

0.47 

1.11 

0.63 

0.30 

0.94 

2 

9 

40507 

-0.22 

55 

36 

0.31 

1.10 

0.76 

1.23 

1.04 

0.33 

0.74 

2 

10 

40534 

0.13 

55 

35 

0.31 

0.95 

-0.33 

0.87 

-0.54 

0.47 

1.14 

2 

11 

40209 

0.42 

51 

30 

0.31 

1.03 

0.33 

1.14 

0.71 

0.37 

0.85 

2 

12 

40977 

0.73 

47 

23 

0.33 

1.22 

1.61 

1.23 

1.04 

0.30 

0.41 

2 

13 

4NF214 

1.00 

105 

67 

0.22 

1.12 

1.45 

1.10 

0.69 

0.28 

0.68 

2 

14 

40388 

1.30 

49 

22 

0.32 

0.96 

-0.26 

0.94 

-0.20 

0.45 

1.10 

2 

15 

40680 

1.52 

55 

22 

0.32 

0.87 

-1.01 

1.30 

1.23 

0.54 

1.17 

2 

16 

40531 

2.02 

51 

15 

0.35 

0.98 

-0.09 

1.40 

1.30 

0.42 

0.93 

2 

17 

4NF212 

2.57 

96 

26 

0.25 

0.87 

-0.99 

0.88 

-0.60 

0.50 

1.19 

2 

18 

40941 

-1.78 

55 

48 

0.44 

1.19 

0.69 

1.06 

0.28 

0.22 

0.88 

2 

19 

40899 

-1.43 

55 

46 

0.42 

1.08 

0.43 

0.83 

-0.03 

0.41 

0.94 

2 

20 

40304 

-1.28 

69 

58 

0.38 

0.82 

-0.76 

0.52 

-0.84 

0.53 

1.20 

2 

21 

40281 

-0.90 

53 

41 

0.38 

1.11 

0.61 

1.37 

0.91 

0.39 

0.80 

2 

22 

40738 

-0.77 

52 

41 

0.37 

0.80 

-1.05 

0.60 

-1.12 

0.51 

1.30 

2 

23 

40743 

-0.22 

55 

35 

0.32 

1.26 

1.70 

1.27 

0.94 

0.33 

0.50 

2 

24 

41195 

0.10 

50 

31 

0.32 

0.96 

-0.24 

0.91 

-0.45 

0.47 

1.11 

2 

25 

40112 

0.54 

65 

37 

0.28 

1.07 

0.68 

1.22 

1.16 

0.36 

0.71 

2 

26 

40125 

0.86 

56 

27 

0.30 

0.63 

-3.70 

0.56 

-2.74 

0.66 

2.05 

2 

27 

4MD415 

1.78 

110 

49 

0.21 

1.11 

1.48 

1.18 

1.82 

0.25 

0.57 

2 

28 

4G126 

-0.29 

128 

103 

0.25 

1.14 

1.03 

1.16 

0.59 

0.28 

0.83 

2 

29 

4G314 

0.47 

93 

58 

0.23 

1.26 

2.97 

1.31 

2.00 

0.09 

0.16 

2 

30 

4G37 

1.18 

110 

63 

0.21 

1.12 

1.57 

1.18 

1.71 

0.24 

0.57 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

3 

1 

40A115 

-0.36 

96 

80 

0.29 

1.06 

0.41 

1.23 

0.82 

0.18 

0.90 

3 

2 

40A46 

0.91 

91 

63 

0.24 

1.07 

0.71 

1.49 

2.48 

0.20 

0.71 

3 

3 

40A313 

1.56 

91 

45 

0.23 

0.83 

-2.39 

0.80 

-2.03 

0.56 

1.65 

3 

4 

4NBT58 

0.28 

109 

83 

0.24 

1.16 

1.27 

1.45 

1.71 

0.18 

0.70 

3 

5 

4NBT45 

0.64 

99 

73 

0.24 

0.88 

-1.00 

0.82 

-0.92 

0.45 

1.21 

3 

6 

4NBT66 

1.29 

89 

50 

0.23 

1.20 

2.31 

1.21 

1.60 

0.20 

0.34 

3 

7 

40963 

-0.78 

59 

45 

0.33 

0.95 

-0.23 

0.82 

-0.39 

0.42 

1.09 

3 

8 

40378 

-0.45 

65 

46 

0.32 

1.16 

1.06 

0.99 

0.07 

0.42 

0.80 

3 

9 

40832 

-0.22 

48 

34 

0.36 

1.09 

0.56 

1.05 

0.25 

0.41 

0.86 

3 

10 

4NF29 

0.09 

104 

75 

0.24 

0.79 

-1.95 

0.66 

-2.06 

0.59 

1.39 

3 

11 

40983 

0.44 

245 

160 

0.15 

0.97 

-0.46 

0.94 

-0.50 

0.42 

1.07 

3 

12 

40061 

0.76 

64 

30 

0.28 

0.99 

-0.03 

1.09 

0.49 

0.42 

0.95 

3 

13 

40687 

1.01 

53 

25 

0.31 

0.88 

-1.00 

0.84 

-0.94 

0.52 

1.34 

3 

14 

4NF24 

1.30 

91 

50 

0.23 

1.08 

1.02 

1.15 

1.29 

0.28 

0.66 

3 

15 

40072 

1.57 

56 

20 

0.31 

1.04 

0.35 

1.18 

0.77 

0.36 

0.83 

3 

16 

40071 

2.08 

59 

16 

0.34 

1.06 

0.44 

1.36 

1.07 

0.39 

0.81 

3 

17 

40220 

2.56 

57 

10 

0.41 

1.10 

0.48 

1.28 

0.69 

0.42 

0.87 

3 

18 

40256 

-1.76 

56 

48 

0.45 

0.84 

-0.48 

0.62 

-0.53 

0.51 

1.14 

3 

19 

40127 

-1.46 

58 

48 

0.38 

1.06 

0.34 

1.05 

0.27 

0.30 

0.93 

3 

20 

40302 

-1.29 

60 

52 

0.42 

0.90 

-0.28 

0.66 

-0.45 

0.44 

1.11 

3 

21 

40757 

-0.93 

55 

45 

0.40 

0.92 

-0.25 

0.72 

-0.39 

0.49 

1.10 

3 

22 

40458 

-0.73 

55 

40 

0.34 

0.89 

-0.66 

0.70 

-0.73 

0.52 

1.23 

3 

23 

40865 

-0.21 

54 

38 

0.34 

1.11 

0.70 

0.99 

0.07 

0.39 

0.86 

3 

24 

40615 

0.13 

159 

117 

0.20 

0.95 

-0.52 

1.01 

0.10 

0.40 

1.08 

3 

25 

41183 

0.52 

57 

27 

0.29 

1.18 

1.66 

1.25 

1.51 

0.25 

0.41 

3 

26 

40584 

0.85 

51 

27 

0.31 

1.30 

2.66 

1.35 

2.03 

0.16 

-0.06 

3 

27 

4MD713 

1.73 

119 

49 

0.20 

1.01 

0.15 

1.04 

0.48 

0.36 

0.94 

3 

28 

4G131 

-0.15 

214 

163 

0.17 

0.96 

-0.47 

0.87 

-0.88 

0.38 

1.08 

3 

29 

4G11 

0.53 

230 

161 

0.16 

1.13 

1.81 

1.21 

1.54 

0.28 

0.73 

3 

30 

4G128 

1.18 

96 

52 

0.22 

1.01 

0.11 

1.13 

0.99 

0.37 

0.91 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

4 

1 

40A16 

-0.35 

92 

71 

0.26 

0.91 

-0.65 

0.79 

-0.83 

0.40 

1.16 

4 

2 

40A35 

0.87 

90 

58 

0.24 

0.85 

-1.67 

0.78 

-1.50 

0.52 

1.42 

4 

3 

40A517 

1.75 

105 

36 

0.22 

1.04 

0.55 

1.16 

1.35 

0.24 

0.81 

4 

4 

4NBT621 

0.33 

103 

70 

0.23 

1.02 

0.19 

0.93 

-0.37 

0.40 

1.00 

4 

5 

4NBT43 

0.64 

110 

75 

0.22 

0.97 

-0.25 

1.04 

0.32 

0.37 

1.03 

4 

6 

4NBT618 

1.31 

110 

60 

0.21 

0.86 

-2.03 

0.82 

-2.00 

0.53 

1.52 

4 

7 

40505 

-0.70 

59 

43 

0.32 

0.72 

-1.86 

0.57 

-1.81 

0.66 

1.45 

4 

8 

40376 

-0.37 

257 

208 

0.17 

0.94 

-0.61 

0.91 

-0.44 

0.39 

1.07 

4 

9 

40089 

-0.23 

65 

45 

0.30 

1.04 

0.29 

0.97 

-0.03 

0.43 

0.95 

4 

10 

4NF13 

0.11 

99 

76 

0.25 

0.93 

-0.52 

0.95 

-0.16 

0.39 

1.11 

4 

11 

4NF39 

0.46 

102 

78 

0.25 

0.79 

-1.73 

0.64 

-1.84 

0.55 

1.34 

4 

12 

4NF47 

0.76 

109 

74 

0.22 

0.89 

-1.14 

0.78 

-1.29 

0.49 

1.27 

4 

13 

40513 

0.90 

54 

25 

0.33 

0.88 

-0.80 

0.85 

-0.27 

0.57 

1.22 

4 

14 

4NF416 

1.31 

120 

60 

0.20 

0.87 

-1.96 

0.84 

-1.88 

0.53 

1.48 

4 

15 

4NF34 

1.59 

95 

45 

0.22 

0.94 

-0.70 

0.96 

-0.33 

0.44 

1.17 

4 

16 

4NF51 

2.03 

95 

35 

0.23 

0.86 

-1.53 

0.78 

-1.61 

0.54 

1.37 

4 

17 

40383 

2.46 

55 

11 

0.39 

1.08 

0.41 

0.92 

-0.05 

0.44 

0.95 

4 

18 

41167 

-1.77 

67 

59 

0.41 

0.92 

-0.22 

0.80 

-0.23 

0.41 

1.08 

4 

19 

40904 

-1.48 

57 

50 

0.43 

0.93 

-0.15 

0.66 

-0.41 

0.36 

1.09 

4 

20 

40130 

-1.29 

57 

47 

0.38 

0.99 

0.04 

0.80 

-0.27 

0.38 

1.03 

4 

21 

40311 

-0.91 

55 

46 

0.40 

0.88 

-0.46 

0.66 

-0.64 

0.45 

1.15 

4 

22 

40257 

-0.71 

48 

35 

0.36 

1.10 

0.62 

1.31 

0.97 

0.28 

0.76 

4 

23 

40561 

-0.20 

57 

35 

0.31 

0.89 

-0.88 

0.80 

-0.86 

0.53 

1.29 

4 

24 

40462 

0.10 

55 

34 

0.31 

1.16 

1.34 

1.38 

1.86 

0.27 

0.45 

4 

25 

4MD15 

0.52 

93 

57 

0.23 

0.98 

-0.23 

1.01 

0.10 

0.37 

1.04 

4 

26 

41003 

0.85 

51 

25 

0.33 

1.30 

2.09 

1.41 

1.21 

0.36 

0.26 

4 

27 

41039 

1.74 

63 

18 

0.30 

1.09 

0.67 

1.03 

0.20 

0.31 

0.86 

4 

28 

4G214 

-0.10 

93 

68 

0.25 

1.06 

0.59 

0.95 

-0.17 

0.28 

0.92 

4 

29 

4G125 

0.54 

110 

79 

0.23 

1.00 

-0.01 

0.96 

-0.15 

0.38 

1.02 

4 

30 

4G311 

1.30 

92 

51 

0.23 

1.41 

4.64 

1.46 

3.37 

-0.01 

-0.41 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

5 

1 

4OA110 

-0.33 

96 

78 

0.28 

0.89 

-0.68 

0.77 

-0.71 

0.41 

1.14 

5 

2 

40A55 

0.89 

89 

54 

0.23 

0.81 

-2.55 

0.77 

-2.01 

0.53 

1.66 

5 

3 

40  A3 14 

1.69 

111 

40 

0.21 

0.95 

-0.69 

0.95 

-0.49 

0.39 

1.16 

5 

4 

4NBT54 

0.49 

110 

78 

0.22 

0.91 

-0.90 

0.80 

-1.30 

0.46 

1.21 

5 

5 

4NBT313 

0.65 

92 

63 

0.24 

0.84 

-1.72 

0.74 

-1.58 

0.52 

1.40 

5 

6 

4NBT67 

1.00 

103 

66 

0.22 

0.94 

-0.71 

0.91 

-0.54 

0.44 

1.16 

5 

7 

40964 

-0.78 

50 

38 

0.37 

0.98 

-0.01 

0.78 

-0.28 

0.44 

1.07 

5 

8 

40355 

-0.40 

55 

37 

0.32 

1.27 

1.75 

1.35 

1.30 

0.24 

0.46 

5 

9 

40538 

-0.25 

67 

45 

0.28 

0.98 

-0.16 

0.85 

-0.50 

0.40 

1.11 

5 

10 

40659 

0.12 

57 

33 

0.30 

1.08 

0.65 

1.19 

1.05 

0.38 

0.75 

5 

11 

40205 

0.47 

55 

30 

0.29 

0.88 

-1.19 

0.82 

-1.00 

0.49 

1.46 

5 

12 

40679 

0.79 

57 

27 

0.31 

0.81 

-1.64 

0.76 

-1.36 

0.57 

1.51 

5 

13 

40201 

0.88 

58 

27 

0.30 

0.91 

-0.73 

0.87 

-0.54 

0.48 

1.25 

5 

14 

40539 

1.31 

54 

24 

0.31 

1.02 

0.23 

1.10 

0.60 

0.43 

0.92 

5 

15 

40212 

1.61 

67 

21 

0.29 

1.02 

0.19 

1.14 

0.68 

0.40 

0.93 

5 

16 

4NF49 

2.06 

105 

43 

0.22 

0.89 

-1.31 

0.91 

-0.76 

0.49 

1.28 

5 

17 

4NF53 

2.59 

109 

35 

0.23 

1.07 

0.70 

1.26 

1.57 

0.34 

0.80 

5 

18 

41049 

-1.66 

54 

49 

0.49 

0.84 

-0.36 

0.64 

-0.23 

0.37 

1.12 

5 

19 

40303 

-1.46 

55 

47 

0.43 

0.80 

-0.67 

0.56 

-0.76 

0.50 

1.19 

5 

20 

40591 

-1.28 

60 

50 

0.37 

0.93 

-0.27 

0.82 

-0.29 

0.40 

1.08 

5 

21 

40716 

-0.92 

57 

45 

0.35 

1.04 

0.27 

1.03 

0.21 

0.33 

0.94 

5 

22 

40871 

-0.70 

46 

38 

0.43 

0.85 

-0.52 

0.81 

-0.21 

0.47 

1.13 

5 

23 

40343 

-0.20 

52 

33 

0.32 

0.90 

-0.80 

0.82 

-0.73 

0.49 

1.28 

5 

24 

40196 

0.12 

71 

47 

0.27 

1.07 

0.65 

1.15 

0.94 

0.24 

0.78 

5 

25 

41028 

0.52 

73 

39 

0.25 

0.98 

-0.22 

1.01 

0.13 

0.39 

1.05 

5 

26 

40861 

0.83 

54 

29 

0.33 

0.88 

-0.81 

0.81 

-0.84 

0.61 

1.26 

5 

27 

40901 

1.78 

53 

17 

0.33 

1.17 

1.12 

1.17 

0.77 

0.29 

0.69 

5 

28 

4G120 

-0.21 

98 

79 

0.27 

1.05 

0.38 

1.18 

0.78 

0.19 

0.89 

5 

29 

4G228 

0.52 

90 

64 

0.25 

0.85 

-1.42 

0.72 

-1.51 

0.51 

1.34 

5 

30 

4G231 

1.32 

90 

40 

0.23 

0.92 

-1.01 

0.95 

-0.36 

0.47 

1.24 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

6 

1 

40A25 

-0.32 

109 

92 

0.28 

0.77 

-1.42 

0.51 

-1.67 

0.52 

1.27 

6 

2 

40A511 

0.90 

89 

57 

0.24 

0.92 

-0.91 

0.82 

-1.18 

0.47 

1.27 

6 

3 

40A425 

1.81 

108 

36 

0.22 

1.28 

3.09 

1.41 

3.13 

-0.07 

0.19 

6 

4 

40498 

0.49 

53 

29 

0.31 

0.82 

-1.63 

1.07 

0.39 

0.54 

1.40 

6 

5 

4NBT32 

0.66 

91 

53 

0.23 

0.94 

-0.75 

0.90 

-0.75 

0.43 

1.23 

6 

6 

4NBT619 

1.00 

89 

52 

0.23 

0.95 

-0.67 

0.94 

-0.46 

0.41 

1.19 

6 

7 

40962 

-0.79 

55 

42 

0.34 

1.03 

0.25 

0.92 

-0.14 

0.33 

0.98 

6 

8 

40358 

-0.37 

64 

46 

0.31 

1.05 

0.35 

1.01 

0.12 

0.38 

0.93 

6 

9 

40375 

-0.26 

53 

36 

0.33 

0.98 

-0.11 

0.86 

-0.43 

0.45 

1.08 

6 

10 

40384 

0.15 

72 

49 

0.29 

0.85 

-1.08 

1.03 

0.19 

0.54 

1.21 

6 

11 

40661 

0.45 

58 

30 

0.29 

0.85 

-1.48 

0.77 

-1.15 

0.54 

1.51 

6 

12 

40051 

0.76 

49 

26 

0.33 

0.80 

-1.75 

0.75 

-1.61 

0.57 

1.61 

6 

13 

40667 

0.91 

56 

25 

0.31 

0.95 

-0.34 

1.05 

0.31 

0.50 

1.05 

6 

14 

40986 

1.32 

55 

21 

0.31 

1.07 

0.52 

1.24 

1.13 

0.39 

0.81 

6 

15 

4NF420 

1.61 

111 

42 

0.21 

1.07 

0.99 

1.13 

1.29 

0.22 

0.72 

6 

16 

40812 

2.06 

54 

15 

0.35 

0.96 

-0.16 

1.33 

0.97 

0.47 

0.99 

6 

17 

4NF514 

2.68 

94 

25 

0.25 

0.94 

-0.48 

1.10 

0.57 

0.41 

1.05 

6 

18 

40278 

-1.70 

55 

48 

0.44 

1.01 

0.14 

1.09 

0.35 

0.31 

0.98 

6 

19 

40589 

-1.49 

54 

45 

0.41 

0.92 

-0.26 

0.66 

-0.63 

0.51 

1.12 

6 

20 

40322 

-1.24 

294 

266 

0.21 

0.99 

-0.02 

0.93 

-0.13 

0.28 

1.00 

6 

21 

40134 

-0.92 

55 

40 

0.35 

0.87 

-0.70 

0.75 

-0.71 

0.53 

1.20 

6 

22 

40349 

-0.70 

56 

45 

0.37 

0.78 

-1.03 

0.66 

-0.77 

0.51 

1.25 

6 

23 

40737 

-0.20 

55 

40 

0.32 

1.03 

0.23 

0.97 

-0.05 

0.30 

0.97 

6 

24 

41062 

0.15 

55 

35 

0.31 

0.75 

-2.35 

0.71 

-1.68 

0.55 

1.72 

6 

25 

4MD68 

0.56 

109 

78 

0.23 

0.93 

-0.68 

0.86 

-0.67 

0.44 

1.15 

6 

26 

40047 

0.89 

55 

24 

0.30 

0.84 

-1.47 

0.77 

-1.37 

0.57 

1.48 

6 

27 

4MD51 

1.87 

91 

39 

0.23 

0.98 

-0.23 

0.96 

-0.37 

0.41 

1.08 

6 

28 

4G217 

-0.32 

114 

88 

0.23 

0.99 

-0.01 

0.91 

-0.48 

0.32 

1.04 

6 

29 

4G15 

0.40 

111 

71 

0.21 

0.85 

-1.97 

0.79 

-2.15 

0.53 

1.48 

6 

30 

4G26 

1.44 

189 

88 

0.16 

1.02 

0.43 

1.06 

0.75 

0.37 

0.90 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

7 

1 

40A112 

-0.32 

106 

90 

0.28 

0.88 

-0.65 

0.79 

-0.57 

0.38 

1.12 

7 

2 

40A414 

0.77 

104 

62 

0.22 

0.83 

-2.06 

0.77 

-2.03 

0.58 

1.47 

7 

3 

40A419 

1.66 

95 

42 

0.23 

1.12 

1.47 

1.13 

1.03 

0.29 

0.62 

7 

4 

4NBT417 

0.47 

121 

81 

0.21 

0.86 

-1.66 

0.86 

-1.16 

0.50 

1.31 

7 

5 

4NBT38 

0.66 

91 

59 

0.24 

1.00 

0.01 

0.96 

-0.22 

0.35 

1.02 

7 

6 

40A11 

1.11 

108 

65 

0.21 

1.08 

0.99 

1.06 

0.50 

0.31 

0.77 

7 

7 

4NF712 

-0.82 

106 

89 

0.28 

1.02 

0.16 

1.18 

0.78 

0.21 

0.95 

7 

8 

40232 

-0.36 

57 

42 

0.33 

0.92 

-0.45 

0.72 

-0.82 

0.48 

1.19 

7 

9 

40235 

-0.28 

51 

35 

0.34 

1.03 

0.23 

1.07 

0.35 

0.41 

0.92 

7 

10 

40076 

0.15 

59 

38 

0.31 

1.07 

0.53 

1.41 

1.35 

0.39 

0.79 

7 

11 

40535 

0.51 

54 

27 

0.31 

0.90 

-0.87 

0.83 

-0.85 

0.54 

1.29 

7 

12 

40958 

0.77 

252 

158 

0.14 

0.94 

-1.14 

0.90 

-1.00 

0.47 

1.16 

7 

13 

4NF21 

0.91 

123 

76 

0.21 

1.30 

3.41 

1.34 

2.05 

0.23 

0.25 

7 

14 

40682 

1.34 

54 

19 

0.32 

1.07 

0.56 

0.99 

0.05 

0.39 

0.89 

7 

15 

4NF110 

1.54 

99 

46 

0.22 

1.05 

0.67 

1.11 

0.91 

0.35 

0.78 

7 

16 

40211 

1.97 

252 

92 

0.15 

0.99 

-0.17 

1.04 

0.40 

0.42 

1.00 

7 

17 

4NF56 

2.48 

94 

27 

0.25 

0.93 

-0.54 

1.20 

1.10 

0.42 

1.04 

7 

18 

40799 

-1.65 

59 

50 

0.38 

0.97 

-0.05 

0.95 

0.01 

0.34 

1.03 

7 

19 

40894 

-1.49 

61 

50 

0.38 

0.93 

-0.21 

0.77 

-0.30 

0.47 

1.08 

7 

20 

40152 

-1.25 

59 

49 

0.37 

0.74 

-1.24 

0.51 

-1.12 

0.54 

1.30 

7 

21 

40295 

-0.87 

56 

46 

0.38 

0.81 

-0.93 

0.61 

-0.77 

0.44 

1.26 

7 

22 

40425 

-0.70 

57 

42 

0.34 

0.93 

-0.36 

1.16 

0.58 

0.44 

1.04 

7 

23 

41097 

-0.19 

55 

36 

0.33 

0.76 

-1.71 

0.60 

-1.49 

0.62 

1.49 

7 

24 

40008 

0.13 

63 

36 

0.29 

1.21 

1.70 

1.31 

1.44 

0.33 

0.47 

7 

25 

40855 

0.59 

59 

33 

0.30 

0.99 

-0.04 

0.89 

-0.44 

0.48 

1.07 

7 

26 

41005 

0.87 

54 

25 

0.30 

1.12 

1.15 

1.12 

0.72 

0.30 

0.60 

7 

27 

40942 

1.79 

49 

16 

0.35 

0.84 

-0.99 

0.71 

-1.01 

0.58 

1.33 

7 

28 

4G12 

-0.08 

232 

185 

0.18 

0.98 

-0.22 

0.86 

-0.65 

0.37 

1.05 

7 

29 

4G312 

0.36 

106 

80 

0.24 

1.00 

0.03 

0.94 

-0.20 

0.34 

1.01 

7 

30 

4G22 

1.46 

108 

62 

0.21 

1.10 

1.33 

1.22 

1.85 

0.25 

0.60 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

8 

1 

40A49 

-0.31 

111 

96 

0.26 

0.91 

-0.58 

0.67 

-1.04 

0.43 

1.14 

8 

2 

40A121 

0.77 

104 

62 

0.22 

0.85 

-1.72 

0.79 

-1.83 

0.56 

1.41 

8 

3 

40A43 

1.88 

214 

89 

0.15 

1.05 

0.78 

1.07 

0.82 

0.38 

0.86 

8 

4 

40938 

0.37 

287 

202 

0.14 

0.90 

-1.64 

0.84 

-1.21 

0.49 

1.19 

8 

5 

4NBT34 

0.66 

214 

131 

0.15 

1.01 

0.20 

0.98 

-0.17 

0.37 

0.98 

8 

6 

4NBT36 

1.34 

113 

49 

0.20 

1.09 

1.34 

1.09 

1.08 

0.22 

0.64 

8 

7 

40835 

-0.81 

55 

43 

0.36 

0.86 

-0.71 

0.62 

-1.00 

0.52 

1.24 

8 

8 

40676 

-0.35 

52 

40 

0.36 

0.81 

-1.06 

0.63 

-1.21 

0.50 

1.32 

8 

9 

4NF33 

-0.27 

91 

69 

0.26 

1.03 

0.27 

1.00 

0.06 

0.28 

0.96 

8 

10 

40831 

0.16 

57 

28 

0.31 

0.83 

-1.29 

0.69 

-1.28 

0.63 

1.39 

8 

11 

4NF11 

0.52 

109 

78 

0.23 

1.00 

-0.02 

0.93 

-0.36 

0.34 

1.03 

8 

12 

40227 

0.79 

54 

26 

0.32 

1.05 

0.44 

1.49 

1.95 

0.44 

0.75 

8 

13 

40540 

0.94 

57 

27 

0.30 

0.73 

-2.31 

0.68 

-1.92 

0.67 

1.63 

8 

14 

4NF415 

1.34 

103 

59 

0.22 

1.02 

0.29 

1.09 

0.69 

0.38 

0.92 

8 

15 

40985 

1.60 

49 

17 

0.34 

1.01 

0.11 

0.89 

-0.36 

0.45 

1.03 

8 

16 

40085 

1.97 

55 

18 

0.33 

0.84 

-1.12 

0.87 

-0.39 

0.58 

1.27 

8 

17 

40368 

2.40 

60 

12 

0.35 

0.96 

-0.14 

0.88 

-0.16 

0.40 

1.06 

8 

18 

41050 

-1.68 

3049 

2676 

0.06 

0.91 

-2.41 

0.78 

-2.81 

0.41 

1.09 

8 

19 

41025 

-1.41 

50 

41 

0.42 

0.78 

-0.84 

0.52 

-1.02 

0.57 

1.25 

8 

20 

40106 

-1.22 

52 

42 

0.41 

0.81 

-0.74 

0.50 

-0.87 

0.60 

1.24 

8 

21 

41154 

-0.89 

54 

43 

0.37 

1.10 

0.54 

0.92 

-0.03 

0.33 

0.92 

8 

22 

40137 

-0.69 

57 

43 

0.34 

0.81 

-1.15 

0.65 

-0.95 

0.55 

1.31 

8 

23 

40342 

-0.19 

55 

34 

0.33 

0.92 

-0.53 

0.92 

-0.22 

0.56 

1.14 

8 

24 

40578 

0.16 

56 

36 

0.31 

1.07 

0.56 

0.95 

-0.15 

0.41 

0.91 

8 

25 

40760 

0.59 

55 

28 

0.31 

0.87 

-1.05 

0.77 

-1.22 

0.56 

1.36 

8 

26 

41161 

0.86 

55 

25 

0.31 

1.23 

1.86 

1.40 

1.78 

0.28 

0.37 

8 

27 

4MD48 

1.89 

91 

30 

0.24 

0.88 

-1.11 

0.82 

-1.24 

0.52 

1.26 

8 

28 

4G225 

-0.05 

120 

94 

0.24 

1.10 

0.82 

1.15 

0.63 

0.28 

0.84 

8 

29 

4G118 

0.38 

116 

75 

0.21 

1.00 

-0.01 

1.01 

0.15 

0.33 

1.00 

8 

30 

4G328 

1.21 

192 

108 

0.16 

1.10 

1.72 

1.07 

0.91 

0.29 

0.69 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

9 

1 

40A513 

-0.22 

119 

94 

0.24 

0.84 

-1.26 

0.70 

-1.56 

0.51 

1.23 

9 

2 

40A23 

0.82 

104 

73 

0.23 

1.01 

0.14 

1.03 

0.24 

0.32 

0.96 

9 

3 

40A516 

1.66 

91 

43 

0.23 

0.85 

-2.06 

0.82 

-1.78 

0.54 

1.56 

9 

4 

4NBT69 

0.44 

89 

56 

0.24 

1.02 

0.26 

0.97 

-0.12 

0.35 

0.97 

9 

5 

4NBT511 

0.69 

103 

72 

0.23 

1.00 

0.08 

0.98 

-0.03 

0.36 

1.00 

9 

6 

40622 

1.34 

59 

24 

0.31 

0.96 

-0.28 

0.83 

-0.76 

0.54 

1.15 

9 

7 

40238 

-0.86 

57 

46 

0.36 

0.87 

-0.60 

1.01 

0.14 

0.38 

1.11 

9 

8 

40087 

-0.35 

55 

37 

0.32 

0.82 

-1.35 

0.72 

-1.19 

0.55 

1.39 

9 

9 

4NF16 

-0.28 

96 

78 

0.27 

1.05 

0.35 

0.91 

-0.26 

0.24 

0.97 

9 

10 

40207 

0.16 

58 

37 

0.30 

1.13 

1.10 

1.38 

1.68 

0.27 

0.57 

9 

11 

40208 

0.42 

54 

28 

0.31 

1.11 

0.88 

1.25 

1.11 

0.40 

0.66 

9 

12 

4NF43 

0.78 

110 

72 

0.22 

1.07 

0.81 

1.18 

1.34 

0.27 

0.78 

9 

13 

4NF311 

0.95 

105 

67 

0.22 

1.02 

0.26 

0.99 

-0.05 

0.34 

0.96 

9 

14 

4NF15 

1.36 

112 

60 

0.21 

0.91 

-1.26 

0.86 

-1.48 

0.49 

1.35 

9 

15 

40537 

1.59 

50 

18 

0.33 

0.95 

-0.32 

0.85 

-0.67 

0.48 

1.16 

9 

16 

40389 

2.00 

55 

19 

0.32 

0.96 

-0.23 

0.93 

-0.23 

0.47 

1.09 

9 

17 

4NF519 

2.59 

89 

24 

0.26 

1.08 

0.66 

1.16 

0.86 

0.32 

0.85 

9 

18 

40148 

-1.66 

57 

49 

0.44 

0.90 

-0.27 

0.87 

-0.07 

0.50 

1.07 

9 

19 

40041 

-1.43 

262 

240 

0.23 

0.90 

-0.53 

0.68 

-1.12 

0.35 

1.08 

9 

20 

40571 

-1.22 

58 

50 

0.40 

1.12 

0.53 

0.93 

0.01 

0.18 

0.93 

9 

21 

40734 

-0.89 

51 

40 

0.39 

1.41 

1.64 

1.43 

1.07 

0.19 

0.57 

9 

22 

40878 

-0.68 

54 

40 

0.36 

0.90 

-0.46 

0.68 

-0.73 

0.57 

1.17 

9 

23 

40598 

-0.18 

48 

37 

0.37 

1.14 

0.79 

1.00 

0.12 

0.21 

0.84 

9 

24 

41199 

0.14 

70 

45 

0.28 

0.93 

-0.61 

0.94 

-0.23 

0.47 

1.15 

9 

25 

41092 

0.56 

49 

28 

0.33 

0.77 

-2.36 

0.69 

-1.60 

0.57 

1.90 

9 

26 

4MD49 

0.89 

95 

59 

0.23 

1.10 

1.19 

1.14 

1.00 

0.26 

0.68 

9 

27 

4MD31 

1.87 

112 

48 

0.21 

0.94 

-0.73 

0.91 

-0.92 

0.46 

1.20 

9 

28 

4G215 

-0.06 

96 

76 

0.26 

0.99 

-0.03 

0.89 

-0.35 

0.32 

1.03 

9 

29 

4G331 

0.35 

103 

78 

0.25 

1.15 

1.27 

1.04 

0.26 

0.22 

0.79 

9 

30 

4G218 

1.23 

110 

62 

0.21 

1.17 

2.26 

1.18 

1.79 

0.20 

0.41 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

10 

1 

41075 

-0.20 

54 

39 

0.33 

0.92 

-0.49 

0.79 

-0.70 

0.46 

1.18 

10 

2 

40A32 

0.85 

120 

76 

0.21 

0.94 

-0.75 

0.92 

-0.44 

0.47 

1.14 

10 

3 

40  A3 12 

1.88 

94 

39 

0.23 

1.10 

1.09 

1.12 

1.04 

0.30 

0.71 

10 

4 

4NBT19 

0.43 

110 

81 

0.23 

0.99 

-0.10 

0.94 

-0.20 

0.37 

1.03 

10 

5 

4NBT44 

0.69 

90 

58 

0.24 

0.90 

-1.15 

0.81 

-1.43 

0.45 

1.34 

10 

6 

4NBT68 

1.37 

119 

58 

0.20 

0.96 

-0.63 

0.97 

-0.31 

0.43 

1.15 

10 

7 

4NF72 

-0.86 

103 

88 

0.30 

0.98 

-0.06 

0.85 

-0.35 

0.35 

1.04 

10 

8 

4NF79 

-0.34 

110 

92 

0.27 

1.09 

0.57 

1.14 

0.57 

0.21 

0.91 

10 

9 

40808 

-0.28 

56 

39 

0.32 

0.98 

-0.10 

0.89 

-0.36 

0.43 

1.06 

10 

10 

40514 

0.16 

49 

30 

0.33 

1.33 

2.26 

1.25 

0.93 

0.26 

0.28 

10 

11 

40084 

0.44 

60 

31 

0.30 

0.78 

-2.10 

0.66 

-1.53 

0.62 

1.61 

10 

12 

40523 

0.80 

55 

26 

0.32 

0.67 

-2.60 

0.57 

-2.42 

0.72 

1.67 

10 

13 

40083 

0.98 

56 

27 

0.30 

1.07 

0.67 

1.15 

0.64 

0.41 

0.74 

10 

14 

40954 

1.32 

55 

21 

0.30 

1.02 

0.24 

1.00 

0.05 

0.38 

0.94 

10 

15 

40522 

1.60 

53 

23 

0.32 

0.83 

-1.30 

0.75 

-1.22 

0.62 

1.40 

10 

16 

4NF513 

2.13 

90 

26 

0.25 

0.93 

-0.55 

0.91 

-0.51 

0.47 

1.13 

10 

17 

4NF714 

2.39 

89 

27 

0.25 

0.75 

-2.22 

0.67 

-2.32 

0.64 

1.46 

10 

18 

40013 

-1.75 

51 

45 

0.49 

1.03 

0.19 

0.62 

-0.41 

0.39 

1.04 

10 

19 

4MD47 

-1.41 

121 

111 

0.34 

0.90 

-0.31 

1.29 

0.80 

0.28 

1.04 

10 

20 

40263 

-1.26 

43 

37 

0.47 

0.99 

0.08 

1.42 

0.76 

0.25 

0.91 

10 

21 

40252 

-0.93 

56 

44 

0.36 

1.18 

0.98 

1.01 

0.17 

0.29 

0.81 

10 

22 

40718 

-0.69 

46 

38 

0.42 

0.93 

-0.21 

0.70 

-0.50 

0.43 

1.11 

10 

23 

40879 

-0.17 

56 

37 

0.32 

0.97 

-0.18 

1.01 

0.13 

0.46 

1.04 

10 

24 

40329 

0.15 

65 

43 

0.31 

1.10 

0.70 

1.28 

0.98 

0.43 

0.79 

10 

25 

41008 

0.56 

55 

30 

0.31 

1.28 

2.15 

1.29 

1.62 

0.26 

0.30 

10 

26 

41006 

0.89 

61 

30 

0.29 

1.15 

1.34 

1.20 

1.17 

0.33 

0.56 

10 

27 

41037 

1.86 

53 

14 

0.34 

1.11 

0.69 

1.41 

1.24 

0.27 

0.75 

10 

28 

4G324 

-0.04 

122 

95 

0.24 

0.97 

-0.24 

0.83 

-0.61 

0.40 

1.07 

10 

29 

4G24 

0.35 

91 

67 

0.25 

0.98 

-0.11 

1.38 

1.76 

0.31 

0.99 

10 

30 

4G19 

1.29 

104 

51 

0.22 

0.98 

-0.20 

0.98 

-0.17 

0.44 

1.06 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMF 

1 

40A416 

-0.41 

119 

99 

0.26 

0.85 

-1.01 

0.59 

-1.32 

0.46 

1.20 

BMF 

2 

40A29 

0.98 

92 

57 

0.23 

0.85 

-1.84 

0.83 

-1.20 

0.51 

1.44 

BMF 

3 

40A57 

1.55 

89 

50 

0.23 

0.95 

-0.61 

0.92 

-0.67 

0.42 

1.20 

BMF 

4 

40763 

0.45 

52 

30 

0.31 

0.80 

-1.68 

0.73 

-1.56 

0.61 

1.53 

BMF 

5 

4NBT11 

0.67 

109 

75 

0.22 

0.96 

-0.45 

0.87 

-0.80 

0.39 

1.14 

BMF 

6 

4NBT14 

1.32 

112 

61 

0.21 

1.03 

0.44 

1.03 

0.33 

0.36 

0.90 

BMF 

7 

4NF713 

-0.76 

110 

97 

0.31 

0.89 

-0.49 

0.69 

-0.92 

0.40 

1.11 

BMF 

8 

4NF25 

-0.43 

114 

90 

0.24 

0.91 

-0.69 

0.84 

-0.83 

0.41 

1.13 

BMF 

9 

40955 

-0.24 

56 

42 

0.34 

0.92 

-0.48 

0.73 

-0.64 

0.46 

1.18 

BMF 

10 

40512 

0.14 

56 

33 

0.30 

0.92 

-0.66 

0.83 

-0.94 

0.49 

1.27 

BMF 

11 

40215 

0.49 

56 

27 

0.31 

1.00 

0.04 

0.99 

0.03 

0.49 

1.00 

BMF 

12 

40052 

0.72 

55 

29 

0.30 

0.94 

-0.50 

0.89 

-0.52 

0.47 

1.20 

BMF 

13 

40689 

0.88 

55 

24 

0.30 

1.01 

0.14 

0.98 

-0.05 

0.40 

0.99 

BMF 

14 

4NF12 

1.35 

97 

51 

0.22 

1.11 

1.45 

1.12 

1.12 

0.27 

0.60 

BMF 

15 

40219 

1.55 

56 

16 

0.33 

1.03 

0.27 

1.02 

0.15 

0.41 

0.94 

BMF 

16 

40969 

2.10 

57 

17 

0.33 

1.14 

0.91 

1.30 

1.15 

0.32 

0.72 

BMF 

17 

40068 

2.42 

3037 

657 

0.05 

0.93 

-2.66 

1.12 

2.10 

0.46 

1.06 

BMF 

18 

40559 

-1.70 

52 

47 

0.50 

1.00 

0.11 

1.02 

0.29 

0.25 

0.98 

BMF 

19 

4MD52 

-1.42 

92 

86 

0.43 

0.96 

0.01 

0.63 

-0.53 

0.26 

1.05 

BMF 

20 

40610 

-1.26 

51 

43 

0.41 

0.88 

-0.41 

0.67 

-0.63 

0.40 

1.15 

BMF 

21 

41093 

-0.89 

46 

36 

0.39 

0.74 

-1.34 

0.52 

-1.22 

0.61 

1.37 

BMF 

22 

40309 

-0.72 

54 

41 

0.35 

0.92 

-0.39 

0.76 

-0.62 

0.47 

1.14 

BMF 

23 

4MD54 

-0.18 

90 

67 

0.26 

0.98 

-0.12 

0.93 

-0.26 

0.33 

1.04 

BMF 

24 

40427 

0.16 

56 

32 

0.30 

1.08 

0.71 

1.01 

0.10 

0.36 

0.83 

BMF 

25 

40430 

0.55 

63 

35 

0.29 

1.17 

1.60 

1.19 

0.82 

0.34 

0.49 

BMF 

26 

40579 

0.86 

62 

28 

0.29 

1.07 

0.61 

1.20 

1.13 

0.39 

0.75 

BMF 

27 

40109 

1.80 

56 

16 

0.33 

1.00 

0.08 

1.20 

0.82 

0.38 

0.95 

BMF 

28 

4G115 

-0.04 

93 

67 

0.25 

1.01 

0.15 

0.98 

-0.03 

0.31 

0.99 

BMF 

29 

4G330 

0.42 

89 

65 

0.26 

0.95 

-0.40 

0.86 

-0.64 

0.40 

1.12 

BMF 

30 

4G226 

1.51 

105 

55 

0.21 

1.03 

0.46 

1.02 

0.24 

0.36 

0.89 

Note.  BMF  = Benchmark  Fall. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMF 

31 

50A34 

-1.24 

237 

219 

0.25 

0.95 

-0.22 

0.75 

-0.64 

0.27 

1.05 

BMF 

32 

5NBT25 

-0.33 

94 

77 

0.28 

0.85 

-0.94 

0.62 

-1.49 

0.44 

1.22 

BMF 

33 

50A11 

-0.15 

112 

85 

0.24 

0.82 

-1.59 

0.76 

-1.25 

0.49 

1.28 

BMF 

34 

5G412 

0.63 

124 

85 

0.21 

0.98 

-0.20 

0.89 

-0.64 

0.34 

1.09 

BMF 

35 

5MD415 

1.00 

95 

42 

0.22 

0.91 

-1.28 

0.88 

-1.31 

0.44 

1.40 

BMF 

36 

3NF29 

-1.15 

106 

98 

0.39 

0.98 

0.03 

1.12 

0.39 

0.26 

1.00 

BMF 

37 

3G119 

-0.69 

225 

202 

0.23 

0.90 

-0.55 

0.68 

-1.12 

0.37 

1.09 

BMF 

38 

3NBT13 

0.24 

117 

91 

0.24 

0.86 

-1.18 

0.67 

-1.33 

0.47 

1.24 

BMF 

39 

3MD26 

0.81 

117 

80 

0.22 

0.89 

-1.24 

0.77 

-1.27 

0.49 

1.27 

BMF 

40 

3NF317 

1.44 

106 

56 

0.22 

0.90 

-1.15 

0.81 

-1.41 

0.55 

1.29 

Note.  BMF  = Benchmark  Fall. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMW 

1 

40A412 

-0.41 

89 

74 

0.29 

0.95 

-0.25 

0.78 

-0.71 

0.32 

1.09 

BMW 

2 

40A124 

1.01 

106 

66 

0.22 

0.96 

-0.50 

0.93 

-0.49 

0.40 

1.13 

BMW 

3 

40A311 

1.53 

90 

36 

0.24 

1.11 

1.23 

1.21 

1.62 

0.27 

0.63 

BMW 

4 

4NBT311 

0.45 

106 

77 

0.23 

0.92 

-0.78 

0.93 

-0.33 

0.39 

1.15 

BMW 

5 

4NBT611 

0.67 

89 

61 

0.25 

0.80 

-2.07 

0.75 

-1.46 

0.55 

1.46 

BMW 

6 

4NBT617 

1.32 

106 

46 

0.21 

1.06 

0.83 

1.08 

0.99 

0.26 

0.75 

BMW 

7 

4NF713 

-0.76 

110 

97 

0.31 

0.89 

-0.49 

0.69 

-0.92 

0.40 

1.11 

BMW 

8 

40506 

-0.43 

54 

40 

0.35 

1.00 

0.03 

1.00 

0.12 

0.44 

1.00 

BMW 

9 

40365 

-0.24 

72 

52 

0.30 

0.79 

-1.60 

0.88 

-0.29 

0.55 

1.30 

BMW 

10 

40803 

0.14 

55 

36 

0.31 

0.95 

-0.39 

0.86 

-0.54 

0.46 

1.16 

BMW 

11 

40809 

0.00 

51 

30 

0.00 

0.92 

-0.68 

0.82 

-0.90 

0.49 

1.29 

BMW 

12 

4NF78 

0.72 

104 

59 

0.21 

1.00 

0.07 

1.01 

0.19 

0.33 

0.97 

BMW 

13 

40672 

0.88 

63 

30 

0.28 

0.96 

-0.42 

0.93 

-0.41 

0.43 

1.16 

BMW 

14 

40980 

1.35 

57 

23 

0.31 

1.04 

0.36 

1.07 

0.32 

0.42 

0.88 

BMW 

15 

40818 

1.55 

52 

19 

0.34 

0.94 

-0.38 

1.09 

0.42 

0.47 

1.05 

BMW 

16 

4NF312 

2.10 

96 

34 

0.23 

0.87 

-1.34 

0.88 

-0.80 

0.51 

1.27 

BMW 

17 

4NF313 

2.42 

92 

30 

0.24 

0.79 

-2.09 

0.76 

-1.69 

0.59 

1.42 

BMW 

18 

40581 

-1.71 

54 

47 

0.44 

0.86 

-0.42 

0.64 

-0.68 

0.48 

1.14 

BMW 

19 

4MD52 

-1.42 

92 

86 

0.43 

0.96 

0.01 

0.63 

-0.53 

0.26 

1.05 

BMW 

20 

40305 

-1.26 

54 

45 

0.39 

0.87 

-0.51 

0.72 

-0.56 

0.41 

1.15 

BMW 

21 

40297 

-0.89 

60 

47 

0.36 

0.86 

-0.66 

0.67 

-0.61 

0.51 

1.19 

BMW 

22 

40714 

-0.72 

50 

36 

0.36 

1.00 

0.05 

0.84 

-0.39 

0.49 

1.04 

BMW 

23 

4MD54 

-0.18 

90 

67 

0.26 

0.98 

-0.12 

0.93 

-0.26 

0.33 

1.04 

BMW 

24 

40759 

0.17 

57 

30 

0.30 

0.95 

-0.41 

0.90 

-0.50 

0.50 

1.16 

BMW 

25 

4MD512 

0.55 

91 

61 

0.24 

1.17 

1.87 

1.32 

1.93 

0.15 

0.47 

BMW 

26 

40432 

0.86 

48 

26 

0.31 

1.14 

1.39 

1.18 

1.15 

0.23 

0.36 

BMW 

27 

4MD78 

1.80 

116 

53 

0.21 

1.35 

3.62 

1.43 

2.91 

0.24 

0.15 

BMW 

28 

4G325 

0.04 

104 

76 

0.24 

0.92 

-0.64 

0.82 

-0.95 

0.47 

1.15 

BMW 

29 

4G119 

0.41 

113 

82 

0.23 

1.32 

2.81 

1.49 

2.66 

0.01 

0.38 

BMW 

30 

4G226 

1.51 

105 

55 

0.21 

1.03 

0.46 

1.02 

0.24 

0.36 

0.89 

Note.  BMW  = Benchmark  Winter. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMW 

31 

50192 

-1.24 

58 

48 

0.38 

0.99 

0.02 

0.89 

-0.08 

0.36 

1.02 

BMW 

32 

50109 

-0.33 

52 

33 

0.33 

0.90 

-0.63 

0.87 

-0.33 

0.55 

1.18 

BMW 

33 

5NBT53 

-0.14 

113 

97 

0.28 

0.84 

-0.88 

0.62 

-1.44 

0.46 

1.18 

BMW 

34 

50A229 

0.62 

99 

71 

0.24 

0.89 

-0.97 

0.79 

-1.24 

0.50 

1.22 

BMW 

35 

5NF79 

0.98 

102 

66 

0.23 

1.01 

0.09 

0.92 

-0.34 

0.41 

1.01 

BMW 

36 

3NF26 

-1.10 

123 

116 

0.40 

0.91 

-0.18 

0.57 

-0.60 

0.33 

1.08 

BMW 

37 

3G17 

-0.69 

108 

97 

0.35 

1.12 

0.58 

1.23 

0.58 

0.26 

0.88 

BMW 

38 

3NBT229 

0.24 

111 

93 

0.28 

0.90 

-0.54 

0.77 

-0.60 

0.41 

1.11 

BMW 

39 

3MD87 

0.82 

107 

78 

0.25 

1.16 

1.26 

1.04 

0.26 

0.41 

0.81 

BMW 

40 

3NF265 

1.42 

120 

71 

0.21 

1.01 

0.15 

0.96 

-0.25 

0.44 

1.01 

Note.  BMW  = Benchmark  Winter. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMS 

1 

40A37 

-0.41 

120 

98 

0.25 

0.96 

-0.21 

0.79 

-0.93 

0.38 

1.08 

BMS 

2 

40A418 

1.04 

105 

65 

0.22 

1.08 

0.98 

1.10 

0.80 

0.30 

0.75 

BMS 

3 

40A54 

1.53 

224 

116 

0.15 

1.03 

0.61 

1.02 

0.25 

0.42 

0.91 

BMS 

4 

4NBT311 

0.45 

106 

77 

0.23 

0.92 

-0.78 

0.93 

-0.33 

0.39 

1.15 

BMS 

5 

4NBT611 

0.67 

89 

61 

0.25 

0.80 

-2.07 

0.75 

-1.46 

0.55 

1.46 

BMS 

6 

4NBT55 

1.32 

89 

46 

0.23 

1.12 

1.49 

1.19 

1.81 

0.26 

0.51 

BMS 

7 

40660 

-0.76 

55 

43 

0.36 

0.98 

-0.06 

0.87 

-0.18 

0.39 

1.05 

BMS 

8 

40966 

-0.42 

50 

36 

0.37 

1.17 

0.92 

1.23 

0.65 

0.39 

0.74 

BMS 

9 

40365 

-0.24 

72 

52 

0.30 

0.79 

-1.60 

0.88 

-0.29 

0.55 

1.30 

BMS 

10 

40803 

0.14 

55 

36 

0.31 

0.95 

-0.39 

0.86 

-0.54 

0.46 

1.16 

BMS 

11 

4NF26 

0.49 

110 

78 

0.22 

1.00 

0.07 

0.93 

-0.40 

0.36 

1.02 

BMS 

12 

40810 

0.72 

62 

30 

0.29 

1.02 

0.18 

1.10 

0.59 

0.43 

0.91 

BMS 

13 

40066 

0.90 

60 

27 

0.31 

0.92 

-0.55 

0.96 

-0.12 

0.51 

1.13 

BMS 

14 

40062 

1.35 

63 

27 

0.30 

0.88 

-1.01 

0.87 

-0.53 

0.55 

1.28 

BMS 

15 

4NF75 

1.55 

91 

44 

0.23 

0.94 

-0.68 

0.95 

-0.42 

0.45 

1.17 

BMS 

16 

4NF312 

2.10 

96 

34 

0.23 

0.87 

-1.34 

0.88 

-0.80 

0.51 

1.27 

BMS 

17 

4NF414 

2.40 

90 

30 

0.24 

1.05 

0.47 

1.10 

0.71 

0.34 

0.87 

BMS 

18 

40873 

-1.71 

44 

40 

0.55 

1.09 

0.35 

1.21 

0.51 

0.15 

0.91 

BMS 

19 

40306 

-1.42 

65 

56 

0.39 

0.94 

-0.16 

1.12 

0.39 

0.35 

1.04 

BMS 

20 

40713 

-1.26 

50 

41 

0.40 

1.03 

0.19 

1.11 

0.38 

0.32 

0.95 

BMS 

21 

40592 

-0.89 

49 

40 

0.42 

0.87 

-0.46 

0.74 

-0.42 

0.53 

1.13 

BMS 

22 

40880 

-0.72 

55 

42 

0.35 

1.03 

0.21 

0.98 

0.07 

0.35 

0.96 

BMS 

23 

40792 

-0.18 

54 

34 

0.32 

0.90 

-0.82 

0.90 

-0.26 

0.48 

1.24 

BMS 

24 

40910 

0.17 

56 

34 

0.31 

1.08 

0.63 

1.29 

1.41 

0.36 

0.76 

BMS 

25 

41033 

0.55 

54 

30 

0.31 

1.01 

0.12 

1.00 

0.05 

0.44 

0.98 

BMS 

26 

40163 

0.86 

55 

28 

0.31 

0.74 

-2.09 

0.88 

-0.45 

0.64 

1.50 

BMS 

27 

4MD72 

1.80 

89 

37 

0.24 

1.21 

2.20 

1.26 

2.25 

0.20 

0.37 

BMS 

28 

4G133 

0.04 

94 

73 

0.26 

1.02 

0.18 

1.10 

0.49 

0.26 

0.94 

BMS 

29 

4G232 

0.41 

209 

141 

0.16 

0.91 

-1.49 

0.88 

-1.14 

0.44 

1.23 

BMS 

30 

4G233 

1.52 

94 

46 

0.22 

0.91 

-1.20 

0.88 

-1.11 

0.49 

1.33 

Note.  BMS  = Benchmark  Spring. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMS 

31 

50661 

-1.25 

52 

41 

0.36 

0.93 

-0.31 

0.98 

0.04 

0.36 

1.07 

BMS 

32 

5G122 

-0.33 

111 

91 

0.26 

0.92 

-0.49 

0.81 

-0.70 

0.36 

1.10 

BMS 

33 

5G34 

-0.15 

125 

95 

0.22 

1.03 

0.33 

1.11 

0.63 

0.28 

0.92 

BMS 

34 

51029 

0.62 

56 

28 

0.30 

0.96 

-0.35 

0.90 

-0.62 

0.48 

1.16 

BMS 

35 

50A322 

1.01 

100 

59 

0.22 

0.86 

-1.98 

0.80 

-1.75 

0.51 

1.54 

BMS 

36 

3NF28 

-1.08 

111 

103 

0.39 

0.95 

-0.08 

0.63 

-0.45 

0.31 

1.05 

BMS 

37 

3G211 

-0.69 

108 

97 

0.35 

0.89 

-0.44 

0.77 

-0.29 

0.40 

1.10 

BMS 

38 

3NBT321 

0.25 

106 

83 

0.26 

0.97 

-0.16 

0.75 

-1.04 

0.44 

1.09 

BMS 

39 

3MD25 

0.83 

127 

88 

0.22 

0.80 

-2.14 

0.65 

-2.06 

0.60 

1.39 

BMS 

40 

3NF280 

1.40 

116 

70 

0.21 

0.96 

-0.50 

0.90 

-0.78 

0.44 

1.15 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Appendix  C:  Distractor  Statistics  by  Test  Form 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

1 

40A52 

* 

-1 

4795 

98 

0.98 

0.02 

0.00 

-0.09 

1 

1 

40A52 

A 

1 

79 

89 

1.99 

0.10 

0.95 

0.36 

1 

1 

40A52 

B 

0 

7 

8 

0.93 

0.18 

0.57 

-0.30 

1 

1 

40A52 

C 

0 

3 

3 

0.99 

0.22 

0.58 

-0.18 

1 

1 

40A52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

2 

40A47 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

1 

2 

40A47 

A 

1 

58 

56 

1.65 

0.12 

0.91 

0.46 

1 

2 

40A47 

B 

0 

16 

15 

0.81 

0.20 

0.92 

-0.18 

1 

2 

40A47 

C 

0 

30 

29 

0.68 

0.18 

0.90 

-0.36 

1 

2 

40A47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

3 

40A113 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

1 

3 

40A113 

A 

1 

52 

43 

1.46 

0.13 

1.38 

0.16 

1 

3 

40A113 

B 

0 

3 

2 

0.42 

1.00 

1.00 

-0.16 

1 

3 

40A113 

C 

0 

66 

55 

1.21 

0.09 

1.15 

-0.11 

1 

3 

40A113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

4 

4NBT47 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

1 

4 

4NBT47 

A 

1 

81 

74 

1.96 

0.12 

0.97 

0.42 

1 

4 

4NBT47 

B 

0 

9 

8 

0.77 

0.31 

0.71 

-0.26 

1 

4 

4NBT47 

C 

0 

19 

17 

1.02 

0.13 

0.76 

-0.29 

1 

4 

4NBT47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

5 

4NBT419 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

1 

5 

4NBT419 

A 

1 

64 

68 

1.83 

0.11 

0.85 

0.52 

1 

5 

4NBT419 

B 

0 

19 

20 

0.94 

0.13 

0.77 

-0.31 

1 

5 

4NBT419 

C 

0 

11 

12 

0.56 

0.18 

0.56 

-0.37 

1 

5 

4NBT419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

6 

4NBT42 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

1 

6 

4NBT42 

A 

1 

52 

57 

1.92 

0.12 

0.90 

0.47 

1 

6 

4NBT42 

B 

0 

33 

36 

1.12 

0.11 

0.86 

-0.36 

1 

6 

4NBT42 

C 

0 

6 

7 

0.73 

0.36 

0.61 

-0.24 

1 

6 

4NBT42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

7 

4NF520 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

1 

7 

4NF520 

A 

1 

88 

85 

1.40 

0.10 

0.92 

0.38 

1 

7 

4NF520 

B 

0 

7 

7 

-0.10 

0.29 

0.46 

-0.36 

1 

7 

4NF520 

C 

0 

9 

9 

0.68 

0.34 

1.17 

-0.17 

1 

7 

4NF520 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

8 

4NF710 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.05 

1 

8 

4NF710 

A 

1 

77 

84 

1.69 

0.10 

0.88 

0.46 

1 

8 

4NF710 

B 

0 

9 

10 

0.41 

0.15 

0.47 

-0.39 

1 

8 

4NF710 

C 

0 

6 

7 

0.72 

0.25 

0.70 

-0.22 

1 

8 

4NF710 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

9 

40685 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.00 

1 

9 

40685 

A 

1 

46 

73 

1.20 

0.18 

1.15 

0.27 

1 

9 

40685 

B 

0 

7 

11 

0.66 

0.44 

1.47 

-0.11 

1 

9 

40685 

C 

0 

5 

8 

0.25 

0.20 

0.66 

-0.19 

1 

9 

40685 

D 

0 

5 

8 

0.48 

0.58 

1.36 

-0.13 

1 

10 

4NF417 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

1 

10 

4NF417 

A 

1 

62 

69 

1.36 

0.12 

0.94 

0.42 

1 

10 

4NF417 

B 

0 

6 

7 

0.00 

0.26 

0.47 

-0.31 

1 

10 

4NF417 

C 

0 

22 

24 

0.62 

0.12 

0.86 

-0.28 

1 

10 

4NF417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

11 

40056 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

1 

11 

40056 

A 

1 

27 

55 

1.09 

0.23 

1.19 

0.35 

1 

11 

40056 

B 

0 

8 

16 

0.47 

0.33 

1.15 

-0.11 

1 

11 

40056 

C 

0 

6 

12 

-0.12 

0.21 

0.50 

-0.30 

1 

11 

40056 

D 

0 

8 

16 

0.51 

0.20 

0.98 

-0.10 

1 

12 

4NF71 

* 

-1 

4795 

98 

1.00 

0.02 

0.00 

-0.01 

1 

12 

4NF71 

A 

1 

51 

57 

1.42 

0.13 

0.93 

0.39 

1 

12 

4NF71 

B 

0 

34 

38 

0.65 

0.16 

1.30 

-0.36 

1 

12 

4NF71 

C 

0 

4 

4 

0.77 

0.21 

0.84 

-0.07 

1 

12 

4NF71 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

13 

40206 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.03 

1 

13 

40206 

A 

1 

23 

43 

1.15 

0.29 

1.56 

0.35 

1 

13 

40206 

B 

0 

18 

34 

0.33 

0.20 

0.89 

-0.17 

1 

13 

40206 

C 

0 

3 

6 

0.28 

0.55 

0.89 

-0.07 

1 

13 

40206 

D 

0 

9 

17 

0.02 

0.51 

1.08 

-0.21 

1 

14 

4NF41 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

1 

14 

4NF41 

A 

1 

51 

49 

1.40 

0.13 

1.33 

0.16 

1 

14 

4NF41 

B 

0 

23 

22 

1.29 

0.24 

2.03 

0.03 

1 

14 

4NF41 

C 

0 

30 

29 

0.92 

0.17 

1.02 

-0.20 

1 

14 

4NF41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

15 

4NF412 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

1 

15 

4NF412 

A 

1 

55 

52 

1.82 

0.17 

1.29 

0.13 

1 

15 

4NF412 

B 

0 

7 

7 

1.05 

0.37 

0.85 

-0.15 

1 

15 

4NF412 

C 

0 

43 

41 

1.62 

0.14 

1.54 

-0.05 

1 

15 

4NF412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

16 

40683 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

1 

16 

40683 

A 

1 

17 

31 

2.06 

0.41 

1.71 

0.46 

1 

16 

40683 

B 

0 

6 

11 

-0.67 

0.21 

0.17 

-0.34 

1 

16 

40683 

C 

0 

16 

29 

0.83 

0.24 

1.01 

-0.04 

1 

16 

40683 

D 

0 

16 

29 

0.44 

0.43 

0.85 

-0.19 

1 

17 

40216 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

1 

17 

40216 

A 

1 

10 

18 

2.24 

0.54 

0.75 

0.53 

1 

17 

40216 

B 

0 

29 

52 

0.26 

0.20 

1.00 

-0.17 

1 

17 

40216 

C 

0 

11 

20 

-0.19 

0.46 

0.97 

-0.23 

1 

17 

40216 

D 

0 

6 

11 

0.11 

0.53 

0.77 

-0.09 

1 

18 

40570 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.02 

1 

18 

40570 

A 

1 

54 

90 

0.88 

0.14 

0.99 

0.28 

1 

18 

40570 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

18 

40570 

C 

0 

2 

3 

-0.65 

0.19 

0.35 

-0.25 

1 

18 

40570 

D 

0 

4 

7 

0.17 

0.25 

0.85 

-0.16 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

19 

40565 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.01 

1 

19 

40565 

A 

1 

54 

87 

0.98 

0.16 

0.96 

0.26 

1 

19 

40565 

B 

0 

2 

3 

0.06 

0.66 

0.86 

-0.12 

1 

19 

40565 

C 

0 

3 

5 

0.39 

0.63 

1.31 

-0.09 

1 

19 

40565 

D 

0 

3 

5 

-0.27 

0.97 

1.20 

-0.21 

1 

20 

41045 

* 

-1 

4813 

99 

1.00 

0.02 

0.00 

0.02 

1 

20 

41045 

A 

1 

60 

85 

0.99 

0.13 

0.96 

0.47 

1 

20 

41045 

B 

0 

9 

13 

-0.23 

0.19 

0.55 

-0.29 

1 

20 

41045 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

20 

41045 

D 

0 

2 

3 

-2.55 

2.99 

0.94 

-0.44 

1 

21 

40189 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

1 

21 

40189 

A 

1 

44 

79 

1.20 

0.19 

0.71 

0.57 

1 

21 

40189 

B 

0 

7 

13 

-0.82 

0.42 

0.50 

-0.43 

1 

21 

40189 

C 

0 

1 

2 

-1.76 

0.00 

0.12 

-0.24 

1 

21 

40189 

D 

0 

4 

7 

-0.38 

0.11 

0.50 

-0.23 

1 

22 

40463 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

1 

22 

40463 

A 

1 

43 

78 

1.22 

0.20 

0.89 

0.41 

1 

22 

40463 

B 

0 

6 

11 

-0.26 

0.30 

0.55 

-0.31 

1 

22 

40463 

C 

0 

2 

4 

0.16 

0.08 

0.69 

-0.11 

1 

22 

40463 

D 

0 

4 

7 

-0.04 

0.59 

0.82 

-0.20 

1 

23 

41052 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.02 

1 

23 

41052 

A 

1 

39 

66 

1.25 

0.22 

0.82 

0.51 

1 

23 

41052 

B 

0 

2 

3 

-0.11 

0.48 

0.66 

-0.11 

1 

23 

41052 

C 

0 

10 

17 

-0.27 

0.40 

1.06 

-0.31 

1 

23 

41052 

D 

0 

8 

14 

-0.37 

0.33 

0.66 

-0.30 

1 

24 

40886 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

1 

24 

40886 

A 

1 

35 

64 

1.28 

0.17 

0.84 

0.54 

1 

24 

40886 

B 

0 

6 

11 

0.30 

0.26 

0.81 

-0.17 

1 

24 

40886 

C 

0 

3 

5 

0.90 

0.36 

1.41 

0.01 

1 

24 

40886 

D 

0 

11 

20 

-0.31 

0.22 

0.49 

-0.53 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

25 

40294 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

1 

25 

40294 

A 

1 

31 

55 

1.06 

0.22 

1.67 

0.24 

1 

25 

40294 

B 

0 

16 

29 

0.60 

0.28 

1.61 

-0.11 

1 

25 

40294 

C 

0 

7 

13 

0.14 

0.41 

0.87 

-0.21 

1 

25 

40294 

D 

0 

2 

4 

0.85 

0.23 

1.14 

0.01 

1 

26 

4MD67 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

1 

26 

4MD67 

A 

1 

60 

58 

1.45 

0.12 

1.13 

0.24 

1 

26 

4MD67 

B 

0 

28 

27 

1.07 

0.18 

1.39 

-0.10 

1 

26 

4MD67 

C 

0 

16 

15 

0.75 

0.29 

1.19 

-0.21 

1 

26 

4MD67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

27 

40409 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.01 

1 

27 

40409 

A 

1 

21 

33 

1.81 

0.32 

1.14 

0.47 

1 

27 

40409 

B 

0 

11 

17 

0.63 

0.31 

0.97 

-0.07 

1 

27 

40409 

C 

0 

11 

17 

0.76 

0.22 

0.98 

-0.03 

1 

27 

40409 

D 

0 

21 

33 

0.07 

0.30 

0.61 

-0.38 

1 

28 

4G319 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.05 

1 

28 

4G319 

A 

1 

75 

82 

1.57 

0.12 

0.97 

0.31 

1 

28 

4G319 

B 

0 

14 

15 

0.74 

0.15 

0.77 

-0.29 

1 

28 

4G319 

C 

0 

3 

3 

0.85 

0.29 

0.80 

-0.10 

1 

28 

4G319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

29 

4G112 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.06 

1 

29 

4G112 

A 

1 

66 

70 

1.73 

0.12 

1.14 

0.28 

1 

29 

4G112 

B 

0 

14 

15 

0.95 

0.17 

0.79 

-0.27 

1 

29 

4G112 

C 

0 

14 

15 

1.35 

0.20 

1.24 

-0.09 

1 

29 

4G112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

30 

4G129 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

1 

30 

4G129 

A 

1 

53 

58 

1.73 

0.13 

1.19 

0.19 

1 

30 

4G129 

B 

0 

22 

24 

1.24 

0.19 

1.16 

-0.20 

1 

30 

4G129 

C 

0 

17 

18 

1.55 

0.23 

1.59 

-0.01 

1 

30 

4G129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

1 

40A38 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

2 

1 

40  A3  8 

A 

1 

70 

78 

1.22 

0.12 

1.04 

0.26 

2 

1 

40  A3  8 

B 

0 

12 

13 

0.76 

0.17 

1.04 

-0.14 

2 

1 

40  A3  8 

C 

0 

8 

9 

0.43 

0.25 

0.79 

-0.22 

2 

1 

40  A3  8 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

2 

40A316 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

2 

2 

40A316 

A 

1 

54 

59 

1.87 

0.14 

0.85 

0.54 

2 

2 

40A316 

B 

0 

20 

22 

0.81 

0.12 

0.71 

-0.33 

2 

2 

40A316 

C 

0 

17 

19 

0.75 

0.10 

0.63 

-0.33 

2 

2 

40A316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

3 

40A48 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

2 

3 

40A48 

A 

1 

54 

50 

2.02 

0.15 

1.21 

0.30 

2 

3 

40A48 

B 

0 

26 

24 

1.49 

0.16 

1.14 

-0.11 

2 

3 

40A48 

C 

0 

29 

27 

1.30 

0.18 

1.11 

-0.23 

2 

3 

40A48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

4 

4NBT51 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.04 

2 

4 

4NBT51 

A 

1 

66 

69 

1.76 

0.11 

0.82 

0.53 

2 

4 

4NBT51 

B 

0 

15 

16 

0.65 

0.14 

0.64 

-0.32 

2 

4 

4NBT51 

C 

0 

14 

15 

0.53 

0.23 

0.69 

-0.36 

2 

4 

4NBT51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

5 

4NBT113 

* 

-1 

4762 

98 

0.99 

0.02 

0.00 

-0.04 

2 

5 

4NBT113 

A 

1 

78 

64 

1.55 

0.10 

1.03 

0.35 

2 

5 

4NBT113 

B 

0 

34 

28 

0.99 

0.14 

1.14 

-0.23 

2 

5 

4NBT113 

C 

0 

10 

8 

0.59 

0.20 

0.66 

-0.24 

2 

5 

4NBT113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

6 

40778 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

2 

6 

40778 

A 

1 

21 

39 

1.69 

0.28 

0.76 

0.58 

2 

6 

40778 

B 

0 

8 

15 

0.24 

0.31 

0.74 

-0.19 

2 

6 

40778 

C 

0 

16 

30 

0.13 

0.18 

0.66 

-0.35 

2 

6 

40778 

D 

0 

9 

17 

0.37 

0.30 

0.89 

-0.15 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

7 

4NF511 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

2 

7 

4NF511 

A 

1 

92 

89 

1.88 

0.10 

0.90 

0.40 

2 

7 

4NF511 

B 

0 

4 

4 

0.70 

0.31 

0.57 

-0.20 

2 

7 

4NF511 

C 

0 

7 

7 

0.47 

0.25 

0.48 

-0.33 

2 

7 

4NF511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

8 

40224 

* 

-1 

4606 

94 

0.97 

0.02 

0.00 

-0.08 

2 

8 

40224 

A 

1 

225 

81 

1.56 

0.07 

1.04 

0.30 

2 

8 

40224 

B 

0 

21 

8 

0.84 

0.19 

1.12 

-0.14 

2 

8 

40224 

C 

0 

28 

10 

0.74 

0.19 

1.24 

-0.20 

2 

8 

40224 

D 

0 

4 

1 

-0.21 

0.41 

0.37 

-0.17 

2 

9 

40507 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

2 

9 

40507 

A 

1 

36 

65 

0.83 

0.16 

0.98 

0.33 

2 

9 

40507 

B 

0 

9 

16 

0.30 

0.34 

1.32 

-0.11 

2 

9 

40507 

C 

0 

7 

13 

-0.39 

0.48 

0.79 

-0.33 

2 

9 

40507 

D 

0 

3 

5 

0.44 

1.06 

2.86 

-0.03 

2 

10 

40534 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

2 

10 

40534 

A 

1 

35 

64 

1.27 

0.19 

1.08 

0.47 

2 

10 

40534 

B 

0 

8 

15 

0.04 

0.21 

0.57 

-0.22 

2 

10 

40534 

C 

0 

4 

7 

0.92 

0.36 

1.46 

0.03 

2 

10 

40534 

D 

0 

8 

15 

-0.69 

0.71 

0.56 

-0.44 

2 

11 

40209 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

2 

11 

40209 

A 

1 

30 

59 

1.32 

0.24 

1.04 

0.37 

2 

11 

40209 

B 

0 

10 

20 

0.53 

0.36 

1.70 

-0.16 

2 

11 

40209 

C 

0 

2 

4 

0.44 

0.41 

0.80 

-0.08 

2 

11 

40209 

D 

0 

9 

18 

0.22 

0.25 

0.76 

-0.27 

2 

12 

40977 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

0.03 

2 

12 

40977 

A 

1 

23 

49 

1.08 

0.28 

1.23 

0.30 

2 

12 

40977 

B 

0 

3 

6 

0.19 

0.75 

1.15 

-0.09 

2 

12 

40977 

C 

0 

5 

11 

0.62 

0.26 

1.13 

-0.01 

2 

12 

40977 

D 

0 

16 

34 

0.19 

0.36 

1.28 

-0.26 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

13 

4NF214 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

2 

13 

4NF214 

A 

1 

67 

64 

1.94 

0.13 

1.09 

0.28 

2 

13 

4NF214 

B 

0 

30 

29 

1.31 

0.17 

1.15 

-0.25 

2 

13 

4NF214 

C 

0 

8 

8 

1.43 

0.16 

0.95 

-0.08 

2 

13 

4NF214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

14 

40388 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.00 

2 

14 

40388 

A 

1 

22 

45 

1.62 

0.23 

0.97 

0.45 

2 

14 

40388 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

14 

40388 

C 

0 

26 

53 

0.71 

0.15 

0.93 

-0.31 

2 

14 

40388 

D 

0 

1 

2 

-3.03 

0.00 

0.02 

-0.51 

2 

15 

40680 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

2 

15 

40680 

A 

1 

22 

40 

1.97 

0.34 

1.63 

0.54 

2 

15 

40680 

B 

0 

8 

15 

0.36 

0.32 

0.71 

-0.20 

2 

15 

40680 

C 

0 

16 

29 

0.36 

0.21 

0.70 

-0.30 

2 

15 

40680 

D 

0 

9 

16 

0.52 

0.33 

0.88 

-0.16 

2 

16 

40531 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

2 

16 

40531 

A 

1 

15 

29 

1.73 

0.40 

1.59 

0.42 

2 

16 

40531 

B 

0 

7 

14 

0.32 

0.35 

0.62 

-0.20 

2 

16 

40531 

C 

0 

22 

43 

0.89 

0.16 

1.09 

-0.04 

2 

16 

40531 

D 

0 

7 

14 

0.03 

0.41 

0.55 

-0.30 

2 

17 

4NF212 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

2 

17 

4NF212 

A 

1 

26 

27 

2.24 

0.22 

0.90 

0.50 

2 

17 

4NF212 

B 

0 

26 

27 

0.84 

0.14 

0.59 

-0.35 

2 

17 

4NF212 

C 

0 

44 

46 

1.26 

0.12 

0.96 

-0.14 

2 

17 

4NF212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

18 

40941 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

2 

18 

40941 

A 

1 

48 

87 

0.66 

0.18 

1.35 

0.22 

2 

18 

40941 

B 

0 

4 

7 

0.28 

0.32 

1.35 

-0.06 

2 

18 

40941 

C 

0 

2 

4 

-0.71 

0.85 

0.62 

-0.20 

2 

18 

40941 

D 

0 

1 

2 

-0.65 

0.00 

0.48 

-0.13 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

19 

40899 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

2 

19 

40899 

A 

1 

46 

84 

1.15 

0.23 

1.07 

0.41 

2 

19 

40899 

B 

0 

2 

4 

0.49 

0.25 

1.27 

-0.04 

2 

19 

40899 

C 

0 

5 

9 

-0.43 

0.39 

0.66 

-0.23 

2 

19 

40899 

D 

0 

2 

4 

-2.86 

2.50 

0.52 

-0.42 

2 

20 

40304 

* 

-1 

4815 

99 

1.00 

0.02 

0.00 

0.00 

2 

20 

40304 

A 

1 

58 

84 

1.36 

0.18 

0.80 

0.53 

2 

20 

40304 

B 

0 

7 

10 

-0.22 

0.25 

0.67 

-0.27 

2 

20 

40304 

C 

0 

3 

4 

-2.00 

0.50 

0.12 

-0.42 

2 

20 

40304 

D 

0 

1 

1 

-1.94 

0.00 

0.10 

-0.23 

2 

21 

40281 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.01 

2 

21 

40281 

A 

1 

41 

77 

1.30 

0.27 

1.00 

0.39 

2 

21 

40281 

B 

0 

9 

17 

-0.22 

0.50 

1.49 

-0.25 

2 

21 

40281 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

21 

40281 

D 

0 

3 

6 

-1.58 

2.26 

1.43 

-0.31 

2 

22 

40738 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.00 

2 

22 

40738 

A 

1 

41 

79 

1.31 

0.20 

0.85 

0.51 

2 

22 

40738 

B 

0 

3 

6 

0.01 

0.35 

0.70 

-0.17 

2 

22 

40738 

C 

0 

3 

6 

-0.66 

0.48 

0.40 

-0.30 

2 

22 

40738 

D 

0 

5 

10 

-0.42 

0.32 

0.49 

-0.33 

2 

23 

40743 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

2 

23 

40743 

A 

1 

35 

64 

0.86 

0.22 

1.24 

0.33 

2 

23 

40743 

B 

0 

6 

11 

0.10 

0.68 

1.66 

-0.09 

2 

23 

40743 

C 

0 

5 

9 

-0.51 

0.41 

0.57 

-0.21 

2 

23 

40743 

D 

0 

9 

16 

-0.22 

0.71 

1.46 

-0.20 

2 

24 

41195 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.03 

2 

24 

41195 

A 

1 

31 

62 

1.02 

0.16 

1.03 

0.47 

2 

24 

41195 

B 

0 

3 

6 

-0.92 

0.39 

0.25 

-0.41 

2 

24 

41195 

C 

0 

12 

24 

0.40 

0.20 

1.04 

-0.15 

2 

24 

41195 

D 

0 

4 

8 

-0.11 

0.48 

0.68 

-0.24 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

25 

40112 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.01 

2 

25 

40112 

A 

1 

37 

57 

1.31 

0.20 

1.07 

0.36 

2 

25 

40112 

B 

0 

13 

20 

0.11 

0.26 

0.78 

-0.33 

2 

25 

40112 

C 

0 

13 

20 

0.63 

0.34 

1.93 

-0.12 

2 

25 

40112 

D 

0 

2 

3 

0.92 

0.12 

1.19 

0.00 

2 

26 

40125 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

2 

26 

40125 

A 

1 

27 

48 

1.75 

0.19 

0.52 

0.66 

2 

26 

40125 

B 

0 

1 

2 

0.77 

0.00 

0.99 

0.00 

2 

26 

40125 

C 

0 

23 

41 

0.08 

0.15 

0.64 

-0.37 

2 

26 

40125 

D 

0 

5 

9 

-1.74 

0.95 

0.24 

-0.52 

2 

27 

4MD415 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

2 

27 

4MD415 

A 

1 

49 

45 

1.78 

0.12 

1.19 

0.25 

2 

27 

4MD415 

B 

0 

24 

22 

1.07 

0.14 

0.78 

-0.28 

2 

27 

4MD415 

C 

0 

37 

34 

1.50 

0.15 

1.43 

-0.02 

2 

27 

4MD415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

28 

4G126 

* 

-1 

4756 

97 

0.98 

0.02 

0.00 

-0.07 

2 

28 

4G126 

A 

1 

103 

80 

1.70 

0.13 

1.16 

0.28 

2 

28 

4G126 

B 

0 

18 

14 

0.81 

0.26 

1.31 

-0.22 

2 

28 

4G126 

C 

0 

7 

5 

0.68 

0.32 

0.81 

-0.15 

2 

28 

4G126 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

29 

4G314 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

2 

29 

4G314 

A 

1 

58 

62 

1.16 

0.14 

1.28 

0.09 

2 

29 

4G314 

B 

0 

10 

11 

0.95 

0.23 

1.29 

-0.05 

2 

29 

4G314 

C 

0 

25 

27 

0.99 

0.15 

1.35 

-0.07 

2 

29 

4G314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

30 

4G37 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

2 

30 

4G37 

A 

1 

63 

57 

1.72 

0.11 

1.17 

0.24 

2 

30 

4G37 

B 

0 

42 

38 

1.36 

0.12 

1.25 

-0.15 

2 

30 

4G37 

C 

0 

5 

5 

0.60 

0.47 

0.64 

-0.23 

2 

30 

4G37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

1 

40A115 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.06 

3 

1 

40A115 

A 

1 

80 

83 

1.58 

0.10 

1.03 

0.18 

3 

1 

40A115 

B 

0 

15 

16 

1.20 

0.22 

1.33 

-0.14 

3 

1 

40A115 

C 

0 

1 

1 

0.29 

0.00 

0.38 

-0.13 

3 

1 

40A115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

2 

40A46 

* 

-1 

4793 

98 

0.98 

0.02 

0.00 

-0.09 

3 

2 

40A46 

A 

1 

63 

69 

1.99 

0.11 

1.03 

0.20 

3 

2 

40A46 

B 

0 

14 

15 

1.54 

0.23 

1.16 

-0.16 

3 

2 

40A46 

C 

0 

14 

15 

1.65 

0.32 

2.23 

-0.10 

3 

2 

40A46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

3 

40A313 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

3 

3 

40A313 

A 

1 

45 

49 

2.06 

0.13 

0.83 

0.56 

3 

3 

40A313 

B 

0 

34 

37 

1.08 

0.12 

0.81 

-0.41 

3 

3 

40A313 

C 

0 

12 

13 

1.00 

0.13 

0.65 

-0.24 

3 

3 

40A313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

4 

4NBT58 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

3 

4 

4NBT58 

A 

1 

83 

76 

1.81 

0.12 

1.11 

0.18 

3 

4 

4NBT58 

B 

0 

16 

15 

1.27 

0.29 

1.69 

-0.17 

3 

4 

4NBT58 

C 

0 

10 

9 

1.49 

0.24 

1.32 

-0.06 

3 

4 

4NBT58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

5 

4NBT45 

* 

-1 

4785 

98 

0.98 

0.02 

0.00 

-0.10 

3 

5 

4NBT45 

A 

1 

73 

74 

2.11 

0.10 

0.88 

0.45 

3 

5 

4NBT45 

B 

0 

13 

13 

1.36 

0.21 

0.93 

-0.21 

3 

5 

4NBT45 

C 

0 

13 

13 

0.98 

0.21 

0.66 

-0.37 

3 

5 

4NBT45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

6 

4NBT66 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.06 

3 

6 

4NBT66 

A 

1 

50 

56 

1.77 

0.15 

1.33 

0.20 

3 

6 

4NBT66 

B 

0 

17 

19 

1.43 

0.18 

1.19 

-0.09 

3 

6 

4NBT66 

C 

0 

22 

25 

1.37 

0.15 

1.05 

-0.14 

3 

6 

4NBT66 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

7 

40963 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.03 

3 

7 

40963 

A 

1 

45 

76 

0.94 

0.17 

0.96 

0.42 

3 

7 

40963 

B 

0 

3 

5 

-1.07 

0.70 

0.40 

-0.35 

3 

7 

40963 

C 

0 

9 

15 

-0.11 

0.22 

0.75 

-0.28 

3 

7 

40963 

D 

0 

2 

3 

0.72 

0.41 

1.52 

0.01 

3 

8 

40378 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.03 

3 

8 

40378 

A 

1 

46 

71 

1.16 

0.21 

1.15 

0.42 

3 

8 

40378 

B 

0 

7 

11 

0.43 

0.26 

1.09 

-0.06 

3 

8 

40378 

C 

0 

2 

3 

-0.76 

0.72 

0.35 

-0.15 

3 

8 

40378 

D 

0 

10 

15 

-0.92 

0.77 

0.93 

-0.41 

3 

9 

40832 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.01 

3 

9 

40832 

A 

1 

34 

71 

1.30 

0.21 

0.96 

0.41 

3 

9 

40832 

B 

0 

3 

6 

-0.10 

0.77 

0.68 

-0.17 

3 

9 

40832 

C 

0 

4 

8 

1.03 

0.33 

1.62 

0.03 

3 

9 

40832 

D 

0 

7 

15 

-0.67 

0.79 

0.92 

-0.43 

3 

10 

4NF29 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

3 

10 

4NF29 

A 

1 

75 

72 

1.61 

0.10 

0.81 

0.59 

3 

10 

4NF29 

B 

0 

8 

8 

0.15 

0.29 

0.54 

-0.32 

3 

10 

4NF29 

C 

0 

21 

20 

0.35 

0.15 

0.62 

-0.45 

3 

10 

4NF29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

11 

40983 

* 

-1 

4639 

95 

0.99 

0.02 

0.00 

-0.04 

3 

11 

40983 

A 

1 

160 

65 

1.56 

0.08 

1.07 

0.42 

3 

11 

40983 

B 

0 

35 

14 

0.51 

0.10 

0.70 

-0.28 

3 

11 

40983 

C 

0 

39 

16 

0.79 

0.13 

1.09 

-0.18 

3 

11 

40983 

D 

0 

11 

4 

0.38 

0.24 

0.67 

-0.17 

3 

12 

40061 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.04 

3 

12 

40061 

A 

1 

30 

47 

1.10 

0.20 

1.25 

0.42 

3 

12 

40061 

B 

0 

3 

5 

0.54 

0.35 

1.04 

0.00 

3 

12 

40061 

C 

0 

6 

9 

0.15 

0.44 

0.88 

-0.11 

3 

12 

40061 

D 

0 

25 

39 

0.01 

0.23 

0.89 

-0.37 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

13 

40687 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.01 

3 

13 

40687 

A 

1 

25 

47 

1.64 

0.22 

0.77 

0.52 

3 

13 

40687 

B 

0 

15 

28 

0.67 

0.28 

1.31 

-0.07 

3 

13 

40687 

C 

0 

7 

13 

-0.03 

0.17 

0.44 

-0.23 

3 

13 

40687 

D 

0 

6 

11 

-1.16 

0.89 

0.34 

-0.48 

3 

14 

4NF24 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

3 

14 

4NF24 

A 

1 

50 

55 

1.78 

0.12 

1.03 

0.28 

3 

14 

4NF24 

B 

0 

21 

23 

1.49 

0.19 

1.50 

-0.04 

3 

14 

4NF24 

C 

0 

20 

22 

1.06 

0.20 

0.97 

-0.29 

3 

14 

4NF24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

15 

40072 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

3 

15 

40072 

A 

1 

20 

36 

1.46 

0.31 

1.33 

0.36 

3 

15 

40072 

B 

0 

12 

21 

0.39 

0.20 

0.67 

-0.15 

3 

15 

40072 

C 

0 

9 

16 

0.98 

0.22 

1.16 

0.06 

3 

15 

40072 

D 

0 

15 

27 

0.10 

0.45 

0.94 

-0.30 

3 

16 

40071 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.02 

3 

16 

40071 

A 

1 

16 

27 

1.57 

0.34 

1.48 

0.39 

3 

16 

40071 

B 

0 

2 

3 

-1.59 

0.07 

0.07 

-0.34 

3 

16 

40071 

C 

0 

22 

37 

0.71 

0.24 

1.27 

-0.03 

3 

16 

40071 

D 

0 

19 

32 

0.36 

0.24 

0.81 

-0.21 

3 

17 

40220 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

3 

17 

40220 

A 

1 

10 

18 

1.85 

0.65 

1.34 

0.42 

3 

17 

40220 

B 

0 

34 

60 

0.16 

0.19 

0.87 

-0.35 

3 

17 

40220 

C 

0 

2 

4 

1.19 

0.98 

2.01 

0.08 

3 

17 

40220 

D 

0 

11 

19 

0.53 

0.29 

1.07 

-0.01 

3 

18 

40256 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

3 

18 

40256 

A 

1 

48 

86 

1.03 

0.21 

0.70 

0.51 

3 

18 

40256 

B 

0 

2 

4 

-1.83 

0.14 

0.16 

-0.28 

3 

18 

40256 

C 

0 

3 

5 

-0.93 

1.18 

0.90 

-0.22 

3 

18 

40256 

D 

0 

3 

5 

-1.80 

1.60 

0.62 

-0.34 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

19 

40127 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.04 

3 

19 

40127 

A 

1 

48 

83 

0.77 

0.20 

1.00 

0.30 

3 

19 

40127 

B 

0 

7 

12 

0.26 

0.23 

1.44 

-0.08 

3 

19 

40127 

C 

0 

2 

3 

-1.41 

0.35 

0.24 

-0.27 

3 

19 

40127 

D 

0 

1 

2 

-2.40 

0.00 

0.08 

-0.28 

3 

20 

40302 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.00 

3 

20 

40302 

A 

1 

52 

87 

1.25 

0.16 

0.93 

0.44 

3 

20 

40302 

B 

0 

5 

8 

0.05 

0.27 

0.59 

-0.21 

3 

20 

40302 

C 

0 

2 

3 

-0.05 

0.97 

0.72 

-0.14 

3 

20 

40302 

D 

0 

1 

2 

-4.51 

0.00 

0.00 

-0.52 

3 

21 

40757 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

3 

21 

40757 

A 

1 

45 

82 

1.31 

0.17 

0.91 

0.49 

3 

21 

40757 

B 

0 

1 

2 

0.47 

0.00 

0.81 

-0.05 

3 

21 

40757 

C 

0 

7 

13 

-0.15 

0.41 

0.67 

-0.29 

3 

21 

40757 

D 

0 

2 

4 

-2.55 

2.80 

0.65 

-0.46 

3 

22 

40458 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

3 

22 

40458 

A 

1 

40 

73 

0.98 

0.19 

0.90 

0.52 

3 

22 

40458 

B 

0 

6 

11 

-0.31 

0.45 

0.79 

-0.19 

3 

22 

40458 

C 

0 

3 

5 

-0.11 

0.29 

0.71 

-0.10 

3 

22 

40458 

D 

0 

6 

11 

-1.53 

0.87 

0.40 

-0.48 

3 

23 

40865 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

3 

23 

40865 

A 

1 

38 

70 

1.28 

0.22 

1.13 

0.39 

3 

23 

40865 

B 

0 

6 

11 

0.36 

0.23 

0.87 

-0.15 

3 

23 

40865 

C 

0 

5 

9 

0.25 

0.48 

1.07 

-0.16 

3 

23 

40865 

D 

0 

5 

9 

-0.31 

0.75 

0.86 

-0.29 

3 

24 

40615 

* 

-1 

4725 

97 

0.98 

0.02 

0.00 

-0.06 

3 

24 

40615 

A 

1 

117 

74 

1.72 

0.11 

0.95 

0.40 

3 

24 

40615 

B 

0 

29 

18 

0.85 

0.16 

1.26 

-0.23 

3 

24 

40615 

C 

0 

10 

6 

0.35 

0.26 

0.63 

-0.23 

3 

24 

40615 

D 

0 

3 

2 

-0.77 

0.34 

0.17 

-0.25 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

25 

41183 

* 

-1 

4827 

99 

1.01 

0.02 

0.00 

0.05 

3 

25 

41183 

A 

1 

27 

47 

0.67 

0.22 

1.42 

0.25 

3 

25 

41183 

B 

0 

10 

18 

-0.09 

0.32 

0.85 

-0.21 

3 

25 

41183 

C 

0 

11 

19 

0.58 

0.23 

1.54 

0.09 

3 

25 

41183 

D 

0 

9 

16 

-0.15 

0.26 

0.72 

-0.23 

3 

26 

40584 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

3 

26 

40584 

A 

1 

27 

53 

1.21 

0.25 

1.32 

0.16 

3 

26 

40584 

B 

0 

16 

31 

1.20 

0.17 

1.74 

0.09 

3 

26 

40584 

C 

0 

1 

2 

-0.92 

0.00 

0.16 

-0.25 

3 

26 

40584 

D 

0 

7 

14 

0.35 

0.29 

0.71 

-0.25 

3 

27 

4MD713 

* 

-1 

4765 

98 

0.99 

0.02 

0.00 

-0.04 

3 

27 

4MD713 

A 

1 

49 

41 

1.69 

0.13 

1.10 

0.36 

3 

27 

4MD713 

B 

0 

42 

35 

1.11 

0.12 

1.04 

-0.17 

3 

27 

4MD713 

C 

0 

28 

24 

0.96 

0.14 

0.85 

-0.22 

3 

27 

4MD713 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

28 

4G131 

* 

-1 

4670 

96 

0.99 

0.02 

0.00 

-0.04 

3 

28 

4G131 

A 

1 

163 

76 

1.40 

0.07 

0.96 

0.38 

3 

28 

4G131 

B 

0 

28 

13 

0.65 

0.13 

0.89 

-0.24 

3 

28 

4G131 

C 

0 

23 

11 

0.54 

0.16 

0.79 

-0.26 

3 

28 

4G131 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

29 

4G11 

* 

-1 

4654 

95 

0.97 

0.02 

0.00 

-0.11 

3 

29 

4G11 

A 

1 

161 

70 

1.84 

0.10 

1.18 

0.28 

3 

29 

4G11 

B 

0 

46 

20 

1.06 

0.12 

1.04 

-0.23 

3 

29 

4G11 

C 

0 

23 

10 

1.23 

0.21 

1.58 

-0.11 

3 

29 

4G11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

30 

4G128 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

3 

30 

4G128 

A 

1 

52 

54 

1.75 

0.13 

0.97 

0.37 

3 

30 

4G128 

B 

0 

25 

26 

1.17 

0.16 

1.18 

-0.14 

3 

30 

4G128 

C 

0 

19 

20 

0.79 

0.25 

1.36 

-0.31 

3 

30 

4G128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

1 

40A16 

* 

-1 

4792 

98 

1.00 

0.02 

0.00 

-0.01 

4 

1 

40A16 

A 

1 

71 

77 

1.29 

0.11 

0.93 

0.40 

4 

1 

40A16 

B 

0 

13 

14 

0.37 

0.16 

0.71 

-0.31 

4 

1 

40A16 

C 

0 

8 

9 

0.44 

0.26 

0.82 

-0.21 

4 

1 

40A16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

2 

40A35 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.06 

4 

2 

40A35 

A 

1 

58 

64 

1.96 

0.12 

0.84 

0.52 

4 

2 

40A35 

B 

0 

16 

18 

1.01 

0.18 

0.78 

-0.29 

4 

2 

40A35 

C 

0 

16 

18 

0.86 

0.18 

0.71 

-0.36 

4 

2 

40A35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

3 

40A517 

* 

-1 

4779 

98 

1.00 

0.02 

0.00 

0.00 

4 

3 

40A517 

A 

1 

36 

34 

1.27 

0.14 

1.24 

0.24 

4 

3 

40A517 

B 

0 

61 

58 

0.92 

0.09 

1.06 

-0.15 

4 

3 

40A517 

C 

0 

8 

8 

0.65 

0.12 

0.67 

-0.14 

4 

3 

40A517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

4 

4NBT621 

* 

-1 

4781 

98 

0.99 

0.02 

0.00 

-0.03 

4 

4 

4NBT621 

A 

1 

70 

68 

1.52 

0.11 

1.01 

0.40 

4 

4 

4NBT621 

B 

0 

13 

13 

0.75 

0.21 

0.91 

-0.19 

4 

4 

4NBT621 

C 

0 

20 

19 

0.59 

0.21 

0.88 

-0.32 

4 

4 

4NBT621 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

5 

4NBT43 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4 

5 

4NBT43 

A 

1 

75 

68 

1.76 

0.09 

0.97 

0.37 

4 

5 

4NBT43 

B 

0 

21 

19 

1.24 

0.19 

1.27 

-0.16 

4 

5 

4NBT43 

C 

0 

14 

13 

0.76 

0.23 

0.78 

-0.33 

4 

5 

4NBT43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

6 

4NBT618 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4 

6 

4NBT618 

A 

1 

60 

55 

1.96 

0.10 

0.85 

0.53 

4 

6 

4NBT618 

B 

0 

32 

29 

1.07 

0.11 

0.80 

-0.33 

4 

6 

4NBT618 

C 

0 

18 

16 

0.92 

0.20 

0.77 

-0.31 

4 

6 

4NBT618 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

7 

40505 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.04 

4 

7 

40505 

A 

1 

43 

73 

0.95 

0.13 

0.74 

0.66 

4 

7 

40505 

B 

0 

9 

15 

-0.75 

0.24 

0.44 

-0.50 

4 

7 

40505 

C 

0 

4 

7 

-0.51 

0.59 

0.72 

-0.25 

4 

7 

40505 

D 

0 

3 

5 

-0.55 

0.21 

0.45 

-0.23 

4 

8 

40376 

* 

-1 

4627 

95 

0.98 

0.02 

0.00 

-0.07 

4 

8 

40376 

A 

1 

208 

81 

1.58 

0.07 

0.94 

0.39 

4 

8 

40376 

B 

0 

19 

7 

0.44 

0.24 

0.95 

-0.24 

4 

8 

40376 

C 

0 

22 

9 

0.77 

0.19 

1.04 

-0.17 

4 

8 

40376 

D 

0 

8 

3 

-0.01 

0.18 

0.38 

-0.23 

4 

9 

40089 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.02 

4 

9 

40089 

A 

1 

45 

69 

1.12 

0.16 

0.99 

0.43 

4 

9 

40089 

B 

0 

6 

9 

0.35 

0.48 

1.28 

-0.12 

4 

9 

40089 

C 

0 

7 

11 

0.31 

0.34 

1.06 

-0.14 

4 

9 

40089 

D 

0 

7 

11 

-0.54 

0.49 

0.61 

-0.39 

4 

10 

4NF13 

* 

-1 

4785 

98 

0.99 

0.02 

0.00 

-0.06 

4 

10 

4NF13 

A 

1 

76 

77 

1.72 

0.10 

0.94 

0.39 

4 

10 

4NF13 

B 

0 

12 

12 

0.83 

0.21 

0.78 

-0.28 

4 

10 

4NF13 

C 

0 

11 

11 

0.87 

0.28 

1.13 

-0.24 

4 

10 

4NF13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

11 

4NF39 

* 

-1 

4782 

98 

0.98 

0.02 

0.00 

-0.10 

4 

11 

4NF39 

A 

1 

78 

76 

2.12 

0.09 

0.83 

0.55 

4 

11 

4NF39 

B 

0 

12 

12 

0.76 

0.15 

0.47 

-0.43 

4 

11 

4NF39 

C 

0 

12 

12 

1.10 

0.18 

0.69 

-0.29 

4 

11 

4NF39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

12 

4NF47 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4 

12 

4NF47 

A 

1 

74 

68 

2.06 

0.12 

0.91 

0.49 

4 

12 

4NF47 

B 

0 

23 

21 

1.02 

0.17 

0.81 

-0.33 

4 

12 

4NF47 

C 

0 

12 

11 

0.78 

0.14 

0.53 

-0.30 

4 

12 

4NF47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

13 

40513 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

4 

13 

40513 

A 

1 

25 

46 

1.65 

0.26 

0.91 

0.57 

4 

13 

40513 

B 

0 

16 

30 

0.09 

0.32 

1.05 

-0.22 

4 

13 

40513 

C 

0 

6 

11 

-0.31 

0.39 

0.50 

-0.21 

4 

13 

40513 

D 

0 

7 

13 

-0.91 

0.72 

0.41 

-0.36 

4 

14 

4NF416 

* 

-1 

4764 

98 

0.99 

0.02 

0.00 

-0.04 

4 

14 

4NF416 

A 

1 

60 

50 

1.77 

0.10 

0.86 

0.53 

4 

14 

4NF416 

B 

0 

15 

13 

0.43 

0.11 

0.46 

-0.38 

4 

14 

4NF416 

C 

0 

45 

38 

0.99 

0.12 

0.95 

-0.28 

4 

14 

4NF416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

15 

4NF34 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.05 

4 

15 

4NF34 

A 

1 

45 

47 

1.92 

0.16 

1.09 

0.44 

4 

15 

4NF34 

B 

0 

31 

33 

1.12 

0.11 

0.84 

-0.28 

4 

15 

4NF34 

C 

0 

19 

20 

1.09 

0.13 

0.79 

-0.22 

4 

15 

4NF34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

16 

4NF51 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.04 

4 

16 

4NF51 

A 

1 

35 

37 

2.13 

0.17 

0.79 

0.54 

4 

16 

4NF51 

B 

0 

39 

41 

0.87 

0.12 

0.70 

-0.44 

4 

16 

4NF51 

C 

0 

21 

22 

1.20 

0.15 

0.91 

-0.11 

4 

16 

4NF51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

17 

40383 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

4 

17 

40383 

A 

1 

11 

20 

1.79 

0.41 

0.89 

0.44 

4 

17 

40383 

B 

0 

14 

25 

0.74 

0.33 

1.56 

0.03 

4 

17 

40383 

C 

0 

17 

31 

0.13 

0.25 

0.75 

-0.28 

4 

17 

40383 

D 

0 

13 

24 

0.36 

0.30 

0.94 

-0.14 

4 

18 

41167 

* 

-1 

4817 

99 

1.00 

0.02 

0.00 

0.03 

4 

18 

41167 

A 

1 

59 

88 

0.83 

0.13 

0.92 

0.41 

4 

18 

41167 

B 

0 

2 

3 

0.77 

0.67 

2.12 

0.02 

4 

18 

41167 

C 

0 

2 

3 

-0.74 

0.11 

0.38 

-0.22 

4 

18 

41167 

D 

0 

4 

6 

-1.21 

0.49 

0.32 

-0.42 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

19 

40904 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

4 

19 

40904 

A 

1 

50 

88 

1.04 

0.16 

0.96 

0.36 

4 

19 

40904 

B 

0 

2 

4 

-0.22 

0.64 

0.60 

-0.19 

4 

19 

40904 

C 

0 

3 

5 

-0.06 

0.47 

0.71 

-0.20 

4 

19 

40904 

D 

0 

2 

4 

-0.42 

0.74 

0.52 

-0.22 

4 

20 

40130 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

4 

20 

40130 

A 

1 

47 

82 

0.89 

0.18 

0.99 

0.38 

4 

20 

40130 

B 

0 

7 

12 

-0.44 

0.34 

0.65 

-0.34 

4 

20 

40130 

C 

0 

1 

2 

1.09 

0.00 

2.31 

0.04 

4 

20 

40130 

D 

0 

2 

4 

-0.69 

0.20 

0.39 

-0.21 

4 

21 

40311 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

-0.01 

4 

21 

40311 

A 

1 

46 

84 

1.37 

0.17 

0.95 

0.45 

4 

21 

40311 

B 

0 

2 

4 

0.46 

0.23 

0.81 

-0.11 

4 

21 

40311 

C 

0 

5 

9 

-0.24 

0.46 

0.62 

-0.35 

4 

21 

40311 

D 

0 

2 

4 

-0.47 

0.41 

0.34 

-0.25 

4 

22 

40257 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.03 

4 

22 

40257 

A 

1 

35 

73 

0.83 

0.23 

1.00 

0.28 

4 

22 

40257 

B 

0 

4 

8 

1.05 

0.44 

3.03 

0.10 

4 

22 

40257 

C 

0 

7 

15 

-0.54 

0.44 

0.74 

-0.35 

4 

22 

40257 

D 

0 

2 

4 

-0.32 

0.53 

0.64 

-0.14 

4 

23 

40561 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.05 

4 

23 

40561 

A 

1 

35 

61 

0.91 

0.19 

0.96 

0.53 

4 

23 

40561 

B 

0 

19 

33 

-0.45 

0.19 

0.68 

-0.51 

4 

23 

40561 

C 

0 

1 

2 

0.19 

0.00 

0.94 

-0.02 

4 

23 

40561 

D 

0 

2 

4 

-0.19 

0.57 

0.74 

-0.10 

4 

24 

40462 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

4 

24 

40462 

A 

1 

34 

62 

1.02 

0.22 

1.14 

0.27 

4 

24 

40462 

B 

0 

10 

18 

0.78 

0.37 

2.34 

0.01 

4 

24 

40462 

C 

0 

4 

7 

0.26 

0.60 

1.32 

-0.11 

4 

24 

40462 

D 

0 

7 

13 

-0.26 

0.23 

0.52 

-0.32 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

25 

4MD15 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

4 

25 

4MD15 

A 

1 

57 

61 

1.37 

0.12 

0.96 

0.37 

4 

25 

4MD15 

B 

0 

34 

37 

0.68 

0.14 

1.07 

-0.33 

4 

25 

4MD15 

C 

0 

2 

2 

0.21 

0.17 

0.47 

-0.14 

4 

25 

4MD15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

26 

41003 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

4 

26 

41003 

A 

1 

25 

49 

1.41 

0.33 

1.36 

0.36 

4 

26 

41003 

B 

0 

15 

29 

0.70 

0.33 

2.10 

-0.05 

4 

26 

41003 

C 

0 

5 

10 

0.13 

0.36 

0.67 

-0.14 

4 

26 

41003 

D 

0 

6 

12 

-0.69 

0.75 

0.54 

-0.35 

4 

27 

41039 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.03 

4 

27 

41039 

A 

1 

18 

29 

1.14 

0.19 

0.98 

0.31 

4 

27 

41039 

B 

0 

41 

65 

0.55 

0.16 

1.25 

-0.07 

4 

27 

41039 

C 

0 

2 

3 

-1.07 

0.14 

0.15 

-0.28 

4 

27 

41039 

D 

0 

2 

3 

-1.45 

0.29 

0.11 

-0.34 

4 

28 

4G214 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

4 

28 

4G214 

A 

1 

68 

73 

1.25 

0.12 

1.08 

0.28 

4 

28 

4G214 

B 

0 

10 

11 

0.59 

0.19 

0.84 

-0.19 

4 

28 

4G214 

C 

0 

15 

16 

0.71 

0.14 

0.94 

-0.18 

4 

28 

4G214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

29 

4G125 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.08 

4 

29 

4G125 

A 

1 

79 

72 

1.95 

0.12 

1.01 

0.38 

4 

29 

4G125 

B 

0 

20 

18 

1.18 

0.18 

1.07 

-0.23 

4 

29 

4G125 

C 

0 

11 

10 

0.84 

0.24 

0.69 

-0.27 

4 

29 

4G125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

30 

4G311 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4 

30 

4G311 

A 

1 

51 

55 

1.57 

0.15 

1.42 

-0.01 

4 

30 

4G311 

B 

0 

40 

43 

1.64 

0.12 

1.52 

0.05 

4 

30 

4G311 

C 

0 

1 

1 

-0.30 

0.00 

0.16 

-0.21 

4 

30 

4G311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

1 

4OA110 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

5 

1 

4OA110 

A 

1 

78 

81 

1.61 

0.11 

0.90 

0.41 

5 

1 

4OA110 

B 

0 

4 

4 

0.73 

0.55 

1.00 

-0.14 

5 

1 

4OA110 

C 

0 

14 

15 

0.49 

0.20 

0.67 

-0.38 

5 

1 

4OA110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

2 

40A55 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

5 

2 

40A55 

A 

1 

54 

61 

1.88 

0.13 

0.80 

0.53 

5 

2 

40A55 

B 

0 

20 

22 

0.91 

0.15 

0.87 

-0.30 

5 

2 

40A55 

C 

0 

15 

17 

0.65 

0.12 

0.57 

-0.37 

5 

2 

40A55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

3 

40A314 

* 

-1 

4773 

98 

1.00 

0.02 

0.00 

-0.01 

5 

3 

40A314 

A 

1 

40 

36 

1.43 

0.12 

0.96 

0.39 

5 

3 

40A314 

B 

0 

33 

30 

0.90 

0.13 

1.00 

-0.13 

5 

3 

40A314 

C 

0 

38 

34 

0.76 

0.10 

0.84 

-0.27 

5 

3 

40A314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

4 

4NBT54 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

5 

4 

4NBT54 

A 

1 

78 

71 

1.79 

0.09 

0.94 

0.46 

5 

4 

4NBT54 

B 

0 

12 

11 

1.02 

0.17 

0.80 

-0.20 

5 

4 

4NBT54 

C 

0 

20 

18 

0.81 

0.16 

0.71 

-0.38 

5 

4 

4NBT54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

5 

4NBT313 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

5 

5 

4NBT313 

A 

1 

63 

68 

1.92 

0.11 

0.88 

0.52 

5 

5 

4NBT313 

B 

0 

6 

7 

0.34 

0.21 

0.38 

-0.35 

5 

5 

4NBT313 

C 

0 

23 

25 

0.98 

0.11 

0.75 

-0.36 

5 

5 

4NBT313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

6 

4NBT67 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

5 

6 

4NBT67 

A 

1 

66 

64 

2.07 

0.12 

0.89 

0.44 

5 

6 

4NBT67 

B 

0 

14 

14 

0.96 

0.22 

0.77 

-0.30 

5 

6 

4NBT67 

C 

0 

23 

22 

1.24 

0.18 

1.01 

-0.26 

5 

6 

4NBT67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

7 

40964 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.02 

5 

7 

40964 

A 

1 

38 

76 

1.13 

0.23 

1.02 

0.44 

5 

7 

40964 

B 

0 

2 

4 

-0.53 

1.53 

0.98 

-0.19 

5 

7 

40964 

C 

0 

10 

20 

-0.29 

0.23 

0.65 

-0.37 

5 

7 

40964 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

8 

40355 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

5 

8 

40355 

A 

1 

37 

67 

0.75 

0.21 

1.11 

0.24 

5 

8 

40355 

B 

0 

8 

15 

-0.04 

0.52 

1.55 

-0.18 

5 

8 

40355 

C 

0 

5 

9 

0.76 

0.24 

1.83 

0.06 

5 

8 

40355 

D 

0 

5 

9 

-0.49 

0.78 

0.98 

-0.24 

5 

9 

40538 

* 

-1 

4817 

99 

1.00 

0.02 

0.00 

0.03 

5 

9 

40538 

A 

1 

45 

67 

0.98 

0.18 

0.97 

0.40 

5 

9 

40538 

B 

0 

7 

10 

0.10 

0.30 

0.88 

-0.17 

5 

9 

40538 

C 

0 

2 

3 

0.09 

0.13 

0.70 

-0.09 

5 

9 

40538 

D 

0 

13 

19 

-0.01 

0.19 

0.76 

-0.30 

5 

10 

40659 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

5 

10 

40659 

A 

1 

33 

58 

0.94 

0.21 

1.19 

0.38 

5 

10 

40659 

B 

0 

9 

16 

0.41 

0.34 

1.50 

-0.04 

5 

10 

40659 

C 

0 

4 

7 

0.62 

0.85 

2.50 

0.02 

5 

10 

40659 

D 

0 

11 

19 

-0.63 

0.25 

0.48 

-0.45 

5 

11 

40205 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

5 

11 

40205 

A 

1 

30 

55 

1.09 

0.14 

0.86 

0.49 

5 

11 

40205 

B 

0 

12 

22 

0.40 

0.17 

0.91 

-0.13 

5 

11 

40205 

C 

0 

5 

9 

-0.17 

0.45 

0.66 

-0.26 

5 

11 

40205 

D 

0 

8 

15 

-0.13 

0.50 

0.72 

-0.32 

5 

12 

40679 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

5 

12 

40679 

A 

1 

27 

47 

1.66 

0.28 

0.82 

0.57 

5 

12 

40679 

B 

0 

3 

5 

0.59 

0.33 

1.02 

0.00 

5 

12 

40679 

C 

0 

14 

25 

0.08 

0.23 

0.75 

-0.17 

5 

12 

40679 

D 

0 

13 

23 

-0.99 

0.53 

0.53 

-0.50 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

13 

40201 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.04 

5 

13 

40201 

A 

1 

27 

47 

1.34 

0.17 

0.87 

0.48 

5 

13 

40201 

B 

0 

16 

28 

0.56 

0.22 

1.13 

-0.01 

5 

13 

40201 

C 

0 

5 

9 

-0.23 

0.66 

0.83 

-0.17 

5 

13 

40201 

D 

0 

10 

17 

-0.98 

0.65 

0.45 

-0.49 

5 

14 

40539 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.00 

5 

14 

40539 

A 

1 

24 

44 

1.56 

0.23 

1.26 

0.43 

5 

14 

40539 

B 

0 

5 

9 

0.94 

0.31 

1.04 

-0.02 

5 

14 

40539 

C 

0 

16 

30 

0.58 

0.27 

0.98 

-0.25 

5 

14 

40539 

D 

0 

9 

17 

0.38 

0.27 

0.66 

-0.25 

5 

15 

40212 

* 

-1 

4817 

99 

1.00 

0.02 

0.00 

0.03 

5 

15 

40212 

A 

1 

21 

31 

1.36 

0.31 

1.21 

0.40 

5 

15 

40212 

B 

0 

5 

7 

0.60 

0.45 

1.33 

-0.02 

5 

15 

40212 

C 

0 

21 

31 

0.24 

0.17 

0.77 

-0.26 

5 

15 

40212 

D 

0 

20 

30 

0.44 

0.21 

1.07 

-0.13 

5 

16 

4NF49 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

5 

16 

4NF49 

A 

1 

43 

41 

2.33 

0.20 

0.97 

0.49 

5 

16 

4NF49 

B 

0 

29 

28 

1.23 

0.12 

0.82 

-0.25 

5 

16 

4NF49 

C 

0 

33 

31 

1.23 

0.13 

0.84 

-0.28 

5 

16 

4NF49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

17 

4NF53 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

5 

17 

4NF53 

A 

1 

35 

32 

2.22 

0.22 

1.39 

0.34 

5 

17 

4NF53 

B 

0 

49 

45 

1.49 

0.13 

1.08 

-0.18 

5 

17 

4NF53 

C 

0 

25 

23 

1.39 

0.14 

0.79 

-0.16 

5 

17 

4NF53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

18 

41049 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

-0.01 

5 

18 

41049 

A 

1 

49 

91 

1.30 

0.17 

0.89 

0.37 

5 

18 

41049 

B 

0 

2 

4 

-1.02 

0.33 

0.21 

-0.34 

5 

18 

41049 

C 

0 

1 

2 

0.00 

0.00 

0.54 

-0.12 

5 

18 

41049 

D 

0 

2 

4 

0.20 

1.05 

1.06 

-0.15 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

19 

40303 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

5 

19 

40303 

A 

1 

47 

85 

1.13 

0.18 

0.84 

0.50 

5 

19 

40303 

B 

0 

2 

4 

-0.33 

0.80 

0.65 

-0.16 

5 

19 

40303 

C 

0 

5 

9 

-0.59 

0.35 

0.47 

-0.32 

5 

19 

40303 

D 

0 

1 

2 

-3.51 

0.00 

0.00 

-0.42 

5 

20 

40591 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.03 

5 

20 

40591 

A 

1 

50 

83 

0.89 

0.15 

0.93 

0.40 

5 

20 

40591 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

20 

40591 

C 

0 

5 

8 

-0.36 

0.43 

0.70 

-0.28 

5 

20 

40591 

D 

0 

5 

8 

-0.27 

0.49 

0.89 

-0.26 

5 

21 

40716 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

5 

21 

40716 

A 

1 

45 

79 

0.90 

0.16 

1.03 

0.33 

5 

21 

40716 

B 

0 

2 

4 

0.26 

1.36 

1.85 

-0.08 

5 

21 

40716 

C 

0 

3 

5 

-0.30 

0.46 

0.63 

-0.22 

5 

21 

40716 

D 

0 

7 

12 

0.05 

0.33 

0.98 

-0.22 

5 

22 

40871 

* 

-1 

4838 

99 

1.00 

0.02 

0.00 

-0.02 

5 

22 

40871 

A 

1 

38 

83 

1.51 

0.17 

0.80 

0.47 

5 

22 

40871 

B 

0 

1 

2 

-0.39 

0.00 

0.29 

-0.20 

5 

22 

40871 

C 

0 

3 

7 

0.44 

0.90 

1.16 

-0.18 

5 

22 

40871 

D 

0 

4 

9 

-0.21 

0.70 

0.69 

-0.37 

5 

23 

40343 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.04 

5 

23 

40343 

A 

1 

33 

63 

0.93 

0.20 

1.06 

0.49 

5 

23 

40343 

B 

0 

4 

8 

-0.23 

0.07 

0.56 

-0.20 

5 

23 

40343 

C 

0 

5 

10 

0.26 

0.30 

1.10 

-0.08 

5 

23 

40343 

D 

0 

10 

19 

-0.40 

0.16 

0.52 

-0.41 

5 

24 

40196 

* 

-1 

4813 

99 

1.00 

0.02 

0.00 

0.01 

5 

24 

40196 

A 

1 

47 

66 

1.05 

0.13 

1.11 

0.24 

5 

24 

40196 

B 

0 

7 

10 

0.69 

0.36 

1.52 

-0.08 

5 

24 

40196 

C 

0 

4 

6 

0.34 

0.52 

0.99 

-0.16 

5 

24 

40196 

D 

0 

13 

18 

0.64 

0.17 

1.05 

-0.14 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

25 

41028 

* 

-1 

4811 

99 

1.00 

0.02 

0.00 

0.03 

5 

25 

41028 

A 

1 

39 

53 

1.00 

0.12 

0.92 

0.39 

5 

25 

41028 

B 

0 

11 

15 

0.36 

0.25 

1.08 

-0.15 

5 

25 

41028 

C 

0 

8 

11 

0.43 

0.38 

1.39 

-0.10 

5 

25 

41028 

D 

0 

15 

21 

0.20 

0.24 

0.93 

-0.27 

5 

26 

40861 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

-0.01 

5 

26 

40861 

A 

1 

29 

54 

1.95 

0.26 

0.79 

0.61 

5 

26 

40861 

B 

0 

7 

13 

0.29 

0.40 

1.04 

-0.20 

5 

26 

40861 

C 

0 

15 

28 

0.01 

0.29 

0.79 

-0.44 

5 

26 

40861 

D 

0 

3 

6 

0.07 

0.44 

0.55 

-0.16 

5 

27 

40901 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.01 

5 

27 

40901 

A 

1 

17 

32 

1.32 

0.25 

1.14 

0.29 

5 

27 

40901 

B 

0 

10 

19 

0.94 

0.28 

1.33 

0.03 

5 

27 

40901 

C 

0 

12 

23 

0.78 

0.34 

1.56 

-0.05 

5 

27 

40901 

D 

0 

14 

26 

0.34 

0.28 

0.89 

-0.30 

5 

28 

4G120 

* 

-1 

4786 

98 

0.99 

0.02 

0.00 

-0.05 

5 

28 

4G120 

A 

1 

79 

81 

1.54 

0.11 

1.02 

0.19 

5 

28 

4G120 

B 

0 

15 

15 

1.12 

0.23 

1.34 

-0.14 

5 

28 

4G120 

C 

0 

4 

4 

0.84 

0.23 

0.77 

-0.13 

5 

28 

4G120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

29 

4G228 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.06 

5 

29 

4G228 

A 

1 

64 

71 

1.91 

0.11 

0.87 

0.51 

5 

29 

4G228 

B 

0 

14 

16 

0.96 

0.17 

0.75 

-0.29 

5 

29 

4G228 

C 

0 

12 

13 

0.70 

0.16 

0.56 

-0.37 

5 

29 

4G228 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

30 

4G231 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

5 

30 

4G231 

A 

1 

40 

44 

1.59 

0.13 

0.81 

0.47 

5 

30 

4G231 

B 

0 

37 

41 

0.59 

0.10 

0.71 

-0.44 

5 

30 

4G231 

C 

0 

13 

14 

0.98 

0.36 

2.33 

-0.05 

5 

30 

4G231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

1 

40A25 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

6 

1 

40A25 

A 

1 

92 

84 

1.94 

0.10 

0.83 

0.52 

6 

1 

40A25 

B 

0 

12 

11 

0.32 

0.10 

0.37 

-0.46 

6 

1 

40A25 

C 

0 

5 

5 

0.66 

0.39 

0.63 

-0.22 

6 

1 

40A25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

2 

40A511 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.06 

6 

2 

40A511 

A 

1 

57 

64 

1.94 

0.13 

0.99 

0.47 

6 

2 

40A511 

B 

0 

29 

33 

0.98 

0.11 

0.71 

-0.46 

6 

2 

40A511 

C 

0 

3 

3 

1.32 

0.22 

0.89 

-0.06 

6 

2 

40A511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

3 

40A425 

* 

-1 

4776 

98 

1.00 

0.02 

0.00 

0.00 

6 

3 

40A425 

A 

1 

36 

33 

0.96 

0.12 

1.49 

-0.07 

6 

3 

40A425 

B 

0 

51 

47 

1.21 

0.10 

1.41 

0.23 

6 

3 

40A425 

C 

0 

21 

19 

0.71 

0.18 

0.89 

-0.21 

6 

3 

40A425 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

4 

40498 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

6 

4 

40498 

A 

1 

29 

55 

1.30 

0.22 

1.55 

0.54 

6 

4 

40498 

B 

0 

3 

6 

-0.29 

0.57 

0.50 

-0.20 

6 

4 

40498 

C 

0 

11 

21 

-0.02 

0.23 

0.65 

-0.31 

6 

4 

40498 

D 

0 

10 

19 

0.09 

0.30 

0.76 

-0.25 

6 

5 

4NBT32 

* 

-1 

4793 

98 

1.00 

0.02 

0.00 

-0.01 

6 

5 

4NBT32 

A 

1 

53 

58 

1.43 

0.14 

1.00 

0.43 

6 

5 

4NBT32 

B 

0 

25 

27 

0.62 

0.13 

0.87 

-0.30 

6 

5 

4NBT32 

C 

0 

13 

14 

0.58 

0.13 

0.73 

-0.22 

6 

5 

4NBT32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

6 

4NBT619 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

6 

6 

4NBT619 

A 

1 

52 

58 

1.80 

0.15 

0.98 

0.41 

6 

6 

4NBT619 

B 

0 

17 

19 

1.12 

0.12 

0.93 

-0.16 

6 

6 

4NBT619 

C 

0 

20 

22 

0.84 

0.16 

0.90 

-0.33 

6 

6 

4NBT619 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

7 

40962 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

6 

7 

40962 

A 

1 

42 

76 

0.78 

0.15 

1.00 

0.33 

6 

7 

40962 

B 

0 

5 

9 

0.19 

0.23 

0.93 

-0.12 

6 

7 

40962 

C 

0 

5 

9 

-0.29 

0.65 

0.90 

-0.27 

6 

7 

40962 

D 

0 

3 

5 

0.07 

0.42 

0.85 

-0.12 

6 

8 

40358 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.02 

6 

8 

40358 

A 

1 

46 

72 

1.03 

0.14 

0.96 

0.38 

6 

8 

40358 

B 

0 

5 

8 

0.43 

0.62 

1.37 

-0.08 

6 

8 

40358 

C 

0 

6 

9 

0.01 

0.30 

0.78 

-0.21 

6 

8 

40358 

D 

0 

7 

11 

-0.16 

0.62 

0.99 

-0.28 

6 

9 

40375 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.03 

6 

9 

40375 

A 

1 

36 

68 

1.02 

0.18 

0.97 

0.45 

6 

9 

40375 

B 

0 

4 

8 

-0.38 

0.28 

0.47 

-0.25 

6 

9 

40375 

C 

0 

12 

23 

0.24 

0.22 

0.99 

-0.19 

6 

9 

40375 

D 

0 

1 

2 

-3.36 

0.00 

0.02 

-0.47 

6 

10 

40384 

* 

-1 

4812 

99 

1.00 

0.02 

0.00 

-0.02 

6 

10 

40384 

A 

1 

49 

68 

1.72 

0.18 

0.94 

0.54 

6 

10 

40384 

B 

0 

12 

17 

-0.11 

0.47 

1.49 

-0.38 

6 

10 

40384 

C 

0 

2 

3 

-0.27 

1.15 

0.56 

-0.16 

6 

10 

40384 

D 

0 

9 

13 

0.20 

0.23 

0.63 

-0.25 

6 

11 

40661 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.04 

6 

11 

40661 

A 

1 

30 

52 

1.15 

0.19 

0.79 

0.54 

6 

11 

40661 

B 

0 

11 

19 

-0.25 

0.31 

0.74 

-0.33 

6 

11 

40661 

C 

0 

12 

21 

0.19 

0.16 

0.85 

-0.16 

6 

11 

40661 

D 

0 

5 

9 

-0.47 

0.62 

0.59 

-0.27 

6 

12 

40051 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.00 

6 

12 

40051 

A 

1 

26 

53 

1.85 

0.31 

0.84 

0.57 

6 

12 

40051 

B 

0 

12 

24 

0.12 

0.18 

0.62 

-0.36 

6 

12 

40051 

C 

0 

7 

14 

0.08 

0.24 

0.60 

-0.27 

6 

12 

40051 

D 

0 

4 

8 

0.39 

0.47 

0.89 

-0.13 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

13 

40667 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

6 

13 

40667 

A 

1 

25 

45 

1.36 

0.26 

1.20 

0.50 

6 

13 

40667 

B 

0 

2 

4 

0.44 

0.30 

0.81 

-0.03 

6 

13 

40667 

C 

0 

16 

29 

0.36 

0.24 

1.15 

-0.16 

6 

13 

40667 

D 

0 

13 

23 

-0.25 

0.20 

0.50 

-0.40 

6 

14 

40986 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

6 

14 

40986 

A 

1 

21 

38 

1.31 

0.30 

1.43 

0.39 

6 

14 

40986 

B 

0 

18 

33 

0.42 

0.19 

0.94 

-0.20 

6 

14 

40986 

C 

0 

7 

13 

0.28 

0.36 

0.80 

-0.15 

6 

14 

40986 

D 

0 

9 

16 

0.44 

0.33 

1.00 

-0.12 

6 

15 

4NF420 

* 

-1 

4773 

98 

1.00 

0.02 

0.00 

-0.01 

6 

15 

4NF420 

A 

1 

42 

38 

1.26 

0.12 

1.17 

0.22 

6 

15 

4NF420 

B 

0 

34 

31 

0.91 

0.12 

1.04 

-0.12 

6 

15 

4NF420 

C 

0 

35 

32 

0.92 

0.13 

1.08 

-0.11 

6 

15 

4NF420 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

16 

40812 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

6 

16 

40812 

A 

1 

15 

28 

1.83 

0.33 

1.36 

0.47 

6 

16 

40812 

B 

0 

17 

31 

0.70 

0.31 

2.02 

-0.05 

6 

16 

40812 

C 

0 

5 

9 

0.96 

0.24 

0.96 

0.04 

6 

16 

40812 

D 

0 

17 

31 

-0.04 

0.27 

0.57 

-0.42 

6 

17 

4NF514 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

6 

17 

4NF514 

A 

1 

25 

27 

2.13 

0.23 

1.17 

0.41 

6 

17 

4NF514 

B 

0 

55 

59 

1.26 

0.10 

0.90 

-0.31 

6 

17 

4NF514 

C 

0 

14 

15 

1.32 

0.18 

0.86 

-0.08 

6 

17 

4NF514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

18 

40278 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

6 

18 

40278 

A 

1 

48 

87 

0.84 

0.18 

0.94 

0.31 

6 

18 

40278 

B 

0 

5 

9 

-0.37 

0.79 

1.32 

-0.26 

6 

18 

40278 

C 

0 

1 

2 

0.04 

0.00 

0.86 

-0.07 

6 

18 

40278 

D 

0 

1 

2 

-0.83 

0.00 

0.36 

-0.16 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

19 

40589 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

6 

19 

40589 

A 

1 

45 

83 

0.83 

0.16 

0.90 

0.51 

6 

19 

40589 

B 

0 

6 

11 

-1.46 

0.34 

0.26 

-0.58 

6 

19 

40589 

C 

0 

1 

2 

0.20 

0.00 

1.09 

-0.04 

6 

19 

40589 

D 

0 

2 

4 

0.45 

0.11 

1.41 

-0.02 

6 

20 

40322 

* 

-1 

4590 

94 

0.97 

0.02 

0.00 

-0.10 

6 

20 

40322 

A 

1 

266 

90 

1.62 

0.07 

0.98 

0.28 

6 

20 

40322 

B 

0 

8 

3 

0.24 

0.32 

0.65 

-0.17 

6 

20 

40322 

C 

0 

16 

5 

0.76 

0.25 

1.16 

-0.15 

6 

20 

40322 

D 

0 

4 

1 

-0.31 

0.60 

0.51 

-0.18 

6 

21 

40134 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.05 

6 

21 

40134 

A 

1 

40 

73 

0.90 

0.21 

0.84 

0.53 

6 

21 

40134 

B 

0 

4 

7 

-0.86 

0.57 

0.65 

-0.22 

6 

21 

40134 

C 

0 

3 

5 

-1.37 

0.37 

0.26 

-0.27 

6 

21 

40134 

D 

0 

8 

15 

-0.87 

0.68 

0.95 

-0.33 

6 

22 

40349 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

-0.01 

6 

22 

40349 

A 

1 

45 

80 

1.49 

0.19 

0.75 

0.51 

6 

22 

40349 

B 

0 

1 

2 

-0.16 

0.00 

0.44 

-0.12 

6 

22 

40349 

C 

0 

5 

9 

-0.11 

0.47 

0.62 

-0.27 

6 

22 

40349 

D 

0 

5 

9 

-0.59 

0.65 

0.69 

-0.38 

6 

23 

40737 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

6 

23 

40737 

A 

1 

40 

73 

1.16 

0.17 

1.06 

0.30 

6 

23 

40737 

B 

0 

9 

16 

0.58 

0.22 

0.99 

-0.17 

6 

23 

40737 

C 

0 

1 

2 

0.49 

0.00 

0.77 

-0.07 

6 

23 

40737 

D 

0 

5 

9 

0.31 

0.39 

0.88 

-0.21 

6 

24 

41062 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

6 

24 

41062 

A 

1 

35 

64 

1.42 

0.20 

0.72 

0.55 

6 

24 

41062 

B 

0 

2 

4 

1.22 

0.41 

1.92 

0.05 

6 

24 

41062 

C 

0 

11 

20 

-0.25 

0.16 

0.46 

-0.47 

6 

24 

41062 

D 

0 

7 

13 

0.07 

0.30 

0.75 

-0.26 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

25 

4MD68 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

6 

25 

4MD68 

A 

1 

78 

72 

1.99 

0.11 

0.92 

0.44 

6 

25 

4MD68 

B 

0 

16 

15 

0.88 

0.17 

0.69 

-0.32 

6 

25 

4MD68 

C 

0 

15 

14 

1.05 

0.24 

0.98 

-0.25 

6 

25 

4MD68 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

26 

40047 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

6 

26 

40047 

A 

1 

24 

44 

1.24 

0.17 

0.75 

0.57 

6 

26 

40047 

B 

0 

5 

9 

0.52 

0.29 

1.06 

-0.01 

6 

26 

40047 

C 

0 

9 

16 

0.32 

0.39 

1.19 

-0.10 

6 

26 

40047 

D 

0 

17 

31 

-0.27 

0.18 

0.52 

-0.53 

6 

27 

4MD51 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

6 

27 

4MD51 

A 

1 

39 

43 

1.98 

0.16 

1.01 

0.41 

6 

27 

4MD51 

B 

0 

27 

30 

1.32 

0.13 

0.92 

-0.17 

6 

27 

4MD51 

C 

0 

25 

27 

1.14 

0.15 

0.84 

-0.28 

6 

27 

4MD51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

28 

4G217 

* 

-1 

4770 

98 

1.00 

0.02 

0.00 

-0.01 

6 

28 

4G217 

A 

1 

88 

77 

1.17 

0.08 

1.01 

0.32 

6 

28 

4G217 

B 

0 

2 

2 

0.86 

0.06 

0.96 

-0.03 

6 

28 

4G217 

C 

0 

24 

21 

0.58 

0.13 

0.87 

-0.32 

6 

28 

4G217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

29 

4G15 

* 

-1 

4773 

98 

1.00 

0.02 

0.00 

-0.01 

6 

29 

4G15 

A 

1 

71 

64 

1.35 

0.08 

0.87 

0.53 

6 

29 

4G15 

B 

0 

26 

23 

0.56 

0.12 

0.79 

-0.35 

6 

29 

4G15 

C 

0 

14 

13 

0.42 

0.14 

0.65 

-0.32 

6 

29 

4G15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

30 

4G26 

* 

-1 

4695 

96 

0.99 

0.02 

0.00 

-0.05 

6 

30 

4G26 

A 

1 

88 

47 

1.68 

0.11 

1.07 

0.37 

6 

30 

4G26 

B 

0 

58 

31 

0.98 

0.10 

1.07 

-0.23 

6 

30 

4G26 

C 

0 

43 

23 

0.97 

0.12 

1.01 

-0.19 

6 

30 

4G26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


119 

Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

1 

40A112 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

7 

1 

40A112 

A 

1 

90 

85 

1.89 

0.10 

0.89 

0.38 

7 

1 

40A112 

B 

0 

7 

7 

1.44 

0.26 

1.27 

-0.07 

7 

1 

40A112 

C 

0 

9 

8 

0.28 

0.19 

0.37 

-0.43 

7 

1 

40A112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

2 

40A414 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

7 

2 

40A414 

A 

1 

62 

60 

1.71 

0.10 

0.78 

0.58 

7 

2 

40A414 

B 

0 

20 

19 

0.18 

0.17 

0.53 

-0.52 

7 

2 

40A414 

C 

0 

22 

21 

0.87 

0.16 

0.96 

-0.19 

7 

2 

40A414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

3 

40A419 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.04 

7 

3 

40A419 

A 

1 

42 

44 

1.74 

0.15 

1.06 

0.29 

7 

3 

40A419 

B 

0 

36 

38 

1.05 

0.16 

1.09 

-0.27 

7 

3 

40A419 

C 

0 

17 

18 

1.33 

0.24 

1.48 

-0.04 

7 

3 

40A419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

4 

4NBT417 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

7 

4 

4NBT417 

A 

1 

81 

67 

1.61 

0.08 

0.85 

0.50 

7 

4 

4NBT417 

B 

0 

16 

13 

1.02 

0.23 

1.29 

-0.12 

7 

4 

4NBT417 

C 

0 

24 

20 

0.44 

0.12 

0.56 

-0.49 

7 

4 

4NBT417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

5 

4NBT38 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

7 

5 

4NBT38 

A 

1 

59 

65 

1.68 

0.14 

1.01 

0.35 

7 

5 

4NBT38 

B 

0 

15 

16 

0.93 

0.18 

0.94 

-0.22 

7 

5 

4NBT38 

C 

0 

17 

19 

0.99 

0.15 

0.93 

-0.21 

7 

5 

4NBT38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

6 

40  A 1 1 

* 

-1 

4776 

98 

0.98 

0.02 

0.00 

-0.08 

7 

6 

40A11 

A 

1 

65 

60 

1.95 

0.15 

1.11 

0.31 

7 

6 

40A11 

B 

0 

36 

33 

1.38 

0.12 

1.13 

-0.19 

7 

6 

40A11 

C 

0 

7 

6 

0.58 

0.24 

0.47 

-0.26 

7 

6 

40  A 1 1 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


120 

Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

7 

4NF712 

* 

-1 

4778 

98 

1.00 

0.02 

0.00 

0.00 

7 

7 

4NF712 

A 

1 

89 

84 

1.09 

0.08 

1.00 

0.21 

7 

7 

4NF712 

B 

0 

4 

4 

0.85 

0.27 

1.12 

-0.05 

7 

7 

4NF712 

C 

0 

13 

12 

0.61 

0.27 

1.25 

-0.20 

7 

7 

4NF712 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

8 

40232 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.00 

7 

8 

40232 

A 

1 

42 

74 

1.28 

0.17 

0.93 

0.48 

7 

8 

40232 

B 

0 

4 

7 

0.19 

0.15 

0.64 

-0.18 

7 

8 

40232 

C 

0 

6 

11 

-0.09 

0.37 

0.61 

-0.30 

7 

8 

40232 

D 

0 

5 

9 

-0.05 

0.46 

0.70 

-0.26 

7 

9 

40235 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.02 

7 

9 

40235 

A 

1 

35 

69 

1.04 

0.18 

1.02 

0.41 

7 

9 

40235 

B 

0 

4 

8 

-0.44 

0.40 

0.53 

-0.29 

7 

9 

40235 

C 

0 

7 

14 

0.76 

0.40 

1.95 

0.01 

7 

9 

40235 

D 

0 

5 

10 

-0.67 

0.22 

0.35 

-0.39 

7 

10 

40076 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.00 

7 

10 

40076 

A 

1 

38 

64 

1.34 

0.20 

1.03 

0.39 

7 

10 

40076 

B 

0 

5 

8 

-0.79 

0.47 

0.32 

-0.40 

7 

10 

40076 

C 

0 

5 

8 

0.63 

0.53 

1.39 

-0.07 

7 

10 

40076 

D 

0 

11 

19 

0.54 

0.38 

2.31 

-0.15 

7 

11 

40535 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

7 

11 

40535 

A 

1 

27 

50 

1.20 

0.22 

0.84 

0.54 

7 

11 

40535 

B 

0 

9 

17 

-0.16 

0.38 

0.93 

-0.26 

7 

11 

40535 

C 

0 

8 

15 

-0.36 

0.37 

0.76 

-0.32 

7 

11 

40535 

D 

0 

10 

19 

0.14 

0.16 

0.76 

-0.16 

7 

12 

40958 

* 

-1 

4632 

95 

0.97 

0.02 

0.00 

-0.08 

7 

12 

40958 

A 

1 

158 

63 

1.84 

0.08 

0.89 

0.47 

7 

12 

40958 

B 

0 

35 

14 

0.66 

0.17 

0.87 

-0.28 

7 

12 

40958 

C 

0 

51 

20 

0.99 

0.12 

1.03 

-0.20 

7 

12 

40958 

D 

0 

8 

3 

-0.31 

0.26 

0.26 

-0.28 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

13 

4NF21 

* 

-1 

4761 

97 

0.98 

0.02 

0.00 

-0.07 

7 

13 

4NF21 

A 

1 

76 

62 

1.81 

0.16 

1.36 

0.23 

7 

13 

4NF21 

B 

0 

32 

26 

0.96 

0.17 

1.01 

-0.29 

7 

13 

4NF21 

C 

0 

15 

12 

1.76 

0.21 

1.99 

0.05 

7 

13 

4NF21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

14 

40682 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

7 

14 

40682 

A 

1 

19 

35 

1.19 

0.23 

0.93 

0.39 

7 

14 

40682 

B 

0 

12 

22 

0.57 

0.26 

1.17 

0.01 

7 

14 

40682 

C 

0 

11 

20 

-0.43 

0.45 

0.76 

-0.40 

7 

14 

40682 

D 

0 

12 

22 

0.35 

0.33 

1.31 

-0.08 

7 

15 

4NF110 

* 

-1 

4785 

98 

0.99 

0.02 

0.00 

-0.04 

7 

15 

4NF110 

A 

1 

46 

46 

1.79 

0.17 

1.28 

0.35 

7 

15 

4NF110 

B 

0 

36 

36 

0.97 

0.13 

0.79 

-0.31 

7 

15 

4NF110 

C 

0 

17 

17 

1.23 

0.21 

1.19 

-0.07 

7 

15 

4NF110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

16 

40211 

* 

-1 

4632 

95 

0.98 

0.02 

0.00 

-0.05 

7 

16 

40211 

A 

1 

92 

37 

1.91 

0.11 

1.08 

0.42 

7 

16 

40211 

B 

0 

48 

19 

0.90 

0.11 

0.78 

-0.17 

7 

16 

40211 

C 

0 

94 

37 

1.09 

0.10 

1.13 

-0.14 

7 

16 

40211 

D 

0 

18 

7 

0.24 

0.26 

0.52 

-0.27 

7 

17 

4NF56 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

7 

17 

4NF56 

A 

1 

27 

29 

2.09 

0.25 

1.35 

0.42 

7 

17 

4NF56 

B 

0 

59 

63 

1.19 

0.10 

0.89 

-0.29 

7 

17 

4NF56 

C 

0 

8 

9 

0.83 

0.26 

0.59 

-0.18 

7 

17 

4NF56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

18 

40799 

* 

-1 

4825 

99 

1.01 

0.02 

0.00 

0.05 

7 

18 

40799 

A 

1 

50 

85 

0.51 

0.13 

0.96 

0.34 

7 

18 

40799 

B 

0 

5 

8 

-0.79 

0.43 

0.60 

-0.35 

7 

18 

40799 

C 

0 

2 

3 

-0.49 

0.06 

0.58 

-0.16 

7 

18 

40799 

D 

0 

2 

3 

0.54 

0.82 

2.18 

0.03 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

19 

40894 

* 

-1 

4823 

99 

1.01 

0.02 

0.00 

0.05 

7 

19 

40894 

A 

1 

50 

82 

0.74 

0.16 

0.81 

0.47 

7 

19 

40894 

B 

0 

6 

10 

-0.79 

0.63 

0.88 

-0.29 

7 

19 

40894 

C 

0 

4 

7 

-0.43 

0.37 

0.78 

-0.17 

7 

19 

40894 

D 

0 

1 

2 

-4.05 

0.00 

0.02 

-0.42 

7 

20 

40152 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.03 

7 

20 

40152 

A 

1 

49 

83 

0.94 

0.14 

0.80 

0.54 

7 

20 

40152 

B 

0 

3 

5 

-0.69 

0.57 

0.51 

-0.28 

7 

20 

40152 

C 

0 

3 

5 

-0.33 

0.37 

0.58 

-0.21 

7 

20 

40152 

D 

0 

4 

7 

-0.87 

0.21 

0.32 

-0.37 

7 

21 

40295 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

-0.02 

7 

21 

40295 

A 

1 

46 

82 

1.58 

0.23 

0.84 

0.44 

7 

21 

40295 

B 

0 

8 

14 

-0.12 

0.25 

0.63 

-0.34 

7 

21 

40295 

C 

0 

1 

2 

-0.58 

0.00 

0.32 

-0.15 

7 

21 

40295 

D 

0 

1 

2 

-1.10 

0.00 

0.19 

-0.20 

7 

22 

40425 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

7 

22 

40425 

A 

1 

42 

74 

1.09 

0.21 

0.82 

0.44 

7 

22 

40425 

B 

0 

3 

5 

-0.38 

1.41 

2.91 

-0.17 

7 

22 

40425 

C 

0 

3 

5 

-0.12 

1.07 

1.58 

-0.13 

7 

22 

40425 

D 

0 

9 

16 

-0.50 

0.36 

0.66 

-0.35 

7 

23 

41097 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

7 

23 

41097 

A 

1 

36 

65 

1.38 

0.21 

0.77 

0.62 

7 

23 

41097 

B 

0 

4 

7 

-0.59 

0.22 

0.37 

-0.22 

7 

23 

41097 

C 

0 

5 

9 

-0.07 

0.29 

0.68 

-0.14 

7 

23 

41097 

D 

0 

10 

18 

-1.10 

0.56 

0.49 

-0.52 

7 

24 

40008 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.04 

7 

24 

40008 

A 

1 

36 

57 

0.93 

0.25 

1.60 

0.33 

7 

24 

40008 

B 

0 

3 

5 

-0.50 

0.55 

0.56 

-0.17 

7 

24 

40008 

C 

0 

17 

27 

0.02 

0.28 

1.13 

-0.23 

7 

24 

40008 

D 

0 

7 

11 

0.23 

0.32 

1.19 

-0.08 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

25 

40855 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.00 

7 

25 

40855 

A 

1 

33 

56 

1.53 

0.23 

0.93 

0.48 

7 

25 

40855 

B 

0 

17 

29 

0.38 

0.26 

1.04 

-0.27 

7 

25 

40855 

C 

0 

1 

2 

0.37 

0.00 

0.65 

-0.06 

7 

25 

40855 

D 

0 

8 

14 

-0.11 

0.28 

0.53 

-0.31 

7 

26 

41005 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

7 

26 

41005 

A 

1 

25 

46 

1.01 

0.20 

1.17 

0.30 

7 

26 

41005 

B 

0 

5 

9 

1.03 

0.20 

1.47 

0.11 

7 

26 

41005 

C 

0 

10 

19 

0.50 

0.24 

1.07 

-0.09 

7 

26 

41005 

D 

0 

14 

26 

0.11 

0.32 

0.91 

-0.33 

7 

27 

40942 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.01 

7 

27 

40942 

A 

1 

16 

33 

1.95 

0.31 

0.66 

0.58 

7 

27 

40942 

B 

0 

5 

10 

0.39 

0.48 

0.90 

-0.13 

7 

27 

40942 

C 

0 

16 

33 

0.63 

0.13 

0.86 

-0.14 

7 

27 

40942 

D 

0 

12 

24 

0.01 

0.37 

0.80 

-0.39 

7 

28 

4G12 

* 

-1 

4652 

95 

0.97 

0.02 

0.00 

-0.11 

7 

28 

4G12 

A 

1 

185 

80 

1.86 

0.08 

0.98 

0.37 

7 

28 

4G12 

B 

0 

24 

10 

0.86 

0.16 

0.87 

-0.22 

7 

28 

4G12 

C 

0 

23 

10 

0.67 

0.19 

0.80 

-0.27 

7 

28 

4G12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

29 

4G312 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

7 

29 

4G312 

A 

1 

80 

75 

1.92 

0.11 

0.97 

0.34 

7 

29 

4G312 

B 

0 

10 

9 

1.27 

0.28 

1.11 

-0.14 

7 

29 

4G312 

C 

0 

16 

15 

1.02 

0.19 

0.81 

-0.29 

7 

29 

4G312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

30 

4G22 

* 

-1 

4776 

98 

0.98 

0.02 

0.00 

-0.10 

7 

30 

4G22 

A 

1 

62 

57 

2.03 

0.12 

1.19 

0.25 

7 

30 

4G22 

B 

0 

27 

25 

1.60 

0.16 

1.41 

-0.15 

7 

30 

4G22 

C 

0 

19 

18 

1.51 

0.17 

0.98 

-0.16 

7 

30 

4G22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

1 

40A49 

* 

-1 

4767 

98 

0.98 

0.02 

0.00 

-0.08 

8 

1 

40A49 

A 

1 

96 

82 

1.88 

0.13 

0.97 

0.43 

8 

1 

40A49 

B 

0 

3 

3 

0.98 

0.33 

0.89 

-0.08 

8 

1 

40A49 

C 

0 

18 

15 

0.38 

0.17 

0.56 

-0.42 

8 

1 

40A49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

2 

40A121 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

8 

2 

40A121 

A 

1 

62 

60 

1.70 

0.11 

0.91 

0.56 

8 

2 

40A121 

B 

0 

40 

38 

0.61 

0.11 

0.73 

-0.50 

8 

2 

40A121 

C 

0 

2 

2 

-0.26 

0.45 

0.27 

-0.21 

8 

2 

40A121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

3 

40A43 

* 

-1 

4670 

96 

0.98 

0.02 

0.00 

-0.08 

8 

3 

40A43 

A 

1 

89 

42 

1.95 

0.12 

1.16 

0.38 

8 

3 

40A43 

B 

0 

49 

23 

1.15 

0.11 

0.91 

-0.17 

8 

3 

40A43 

C 

0 

76 

36 

1.13 

0.11 

0.97 

-0.25 

8 

3 

40A43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

4 

40938 

* 

-1 

4597 

94 

0.97 

0.02 

0.00 

-0.10 

8 

4 

40938 

A 

1 

202 

70 

1.88 

0.08 

0.96 

0.49 

8 

4 

40938 

B 

0 

38 

13 

0.55 

0.13 

0.70 

-0.30 

8 

4 

40938 

C 

0 

40 

14 

0.71 

0.14 

0.96 

-0.26 

8 

4 

40938 

D 

0 

7 

2 

-0.13 

0.40 

0.37 

-0.21 

8 

5 

4NBT34 

* 

-1 

4670 

96 

0.99 

0.02 

0.00 

-0.04 

8 

5 

4NBT34 

A 

1 

131 

61 

1.47 

0.08 

1.03 

0.37 

8 

5 

4NBT34 

B 

0 

33 

15 

1.01 

0.13 

1.18 

-0.09 

8 

5 

4NBT34 

C 

0 

50 

23 

0.65 

0.10 

0.80 

-0.34 

8 

5 

4NBT34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

6 

4NBT36 

* 

-1 

4771 

98 

1.00 

0.02 

0.00 

-0.01 

8 

6 

4NBT36 

A 

1 

49 

43 

1.23 

0.10 

1.10 

0.22 

8 

6 

4NBT36 

B 

0 

14 

12 

0.36 

0.16 

0.56 

-0.35 

8 

6 

4NBT36 

C 

0 

50 

44 

1.05 

0.10 

1.23 

0.01 

8 

6 

4NBT36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

7 

40835 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

8 

7 

40835 

A 

1 

43 

78 

1.19 

0.18 

0.93 

0.52 

8 

7 

40835 

B 

0 

4 

7 

-0.41 

0.17 

0.41 

-0.23 

8 

7 

40835 

C 

0 

1 

2 

0.39 

0.00 

0.88 

-0.04 

8 

7 

40835 

D 

0 

7 

13 

-0.96 

0.79 

0.58 

-0.45 

8 

8 

40676 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

-0.02 

8 

8 

40676 

A 

1 

40 

77 

1.52 

0.19 

0.84 

0.50 

8 

8 

40676 

B 

0 

1 

2 

-0.67 

0.00 

0.23 

-0.21 

8 

8 

40676 

C 

0 

5 

10 

0.19 

0.30 

0.63 

-0.26 

8 

8 

40676 

D 

0 

6 

12 

0.07 

0.30 

0.57 

-0.32 

8 

9 

4NF33 

* 

-1 

4793 

98 

1.00 

0.02 

0.00 

-0.01 

8 

9 

4NF33 

A 

1 

69 

76 

1.23 

0.12 

1.02 

0.28 

8 

9 

4NF33 

B 

0 

8 

9 

0.40 

0.14 

0.67 

-0.22 

8 

9 

4NF33 

C 

0 

14 

15 

0.74 

0.22 

1.17 

-0.15 

8 

9 

4NF33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

10 

40831 

* 

-1 

4827 

99 

1.01 

0.02 

0.00 

0.07 

8 

10 

40831 

A 

1 

28 

49 

1.07 

0.22 

0.70 

0.63 

8 

10 

40831 

B 

0 

3 

5 

-0.84 

0.45 

0.45 

-0.16 

8 

10 

40831 

C 

0 

11 

19 

-0.55 

0.21 

0.64 

-0.23 

8 

10 

40831 

D 

0 

15 

26 

-0.92 

0.36 

0.77 

-0.43 

8 

11 

4NF11 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

8 

11 

4NF11 

A 

1 

78 

72 

1.90 

0.13 

1.00 

0.34 

8 

11 

4NF11 

B 

0 

14 

13 

0.83 

0.18 

0.68 

-0.29 

8 

11 

4NF11 

C 

0 

17 

16 

1.26 

0.17 

1.08 

-0.16 

8 

11 

4NF11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

12 

40227 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

8 

12 

40227 

A 

1 

26 

48 

1.28 

0.25 

1.83 

0.44 

8 

12 

40227 

B 

0 

7 

13 

0.34 

0.68 

2.28 

-0.09 

8 

12 

40227 

C 

0 

2 

4 

0.67 

0.93 

1.39 

0.00 

8 

12 

40227 

D 

0 

19 

35 

-0.06 

0.22 

0.67 

-0.39 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

13 

40540 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

8 

13 

40540 

A 

1 

27 

47 

1.63 

0.16 

0.66 

0.67 

8 

13 

40540 

B 

0 

15 

26 

0.20 

0.22 

0.79 

-0.30 

8 

13 

40540 

C 

0 

3 

5 

0.05 

0.51 

0.59 

-0.15 

8 

13 

40540 

D 

0 

12 

21 

-0.16 

0.30 

0.61 

-0.42 

8 

14 

4NF415 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

8 

14 

4NF415 

A 

1 

59 

57 

2.07 

0.14 

1.04 

0.38 

8 

14 

4NF415 

B 

0 

29 

28 

1.26 

0.13 

0.87 

-0.29 

8 

14 

4NF415 

C 

0 

15 

15 

1.33 

0.27 

1.60 

-0.16 

8 

14 

4NF415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

15 

40985 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

8 

15 

40985 

A 

1 

17 

35 

1.53 

0.25 

0.85 

0.45 

8 

15 

40985 

B 

0 

11 

22 

1.04 

0.36 

1.64 

0.11 

8 

15 

40985 

C 

0 

4 

8 

0.05 

0.41 

0.51 

-0.19 

8 

15 

40985 

D 

0 

17 

35 

0.08 

0.23 

0.59 

-0.44 

8 

16 

40085 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

8 

16 

40085 

A 

1 

18 

33 

2.09 

0.26 

0.90 

0.58 

8 

16 

40085 

B 

0 

12 

22 

0.53 

0.31 

0.80 

-0.18 

8 

16 

40085 

C 

0 

23 

42 

0.49 

0.24 

0.83 

-0.32 

8 

16 

40085 

D 

0 

2 

4 

-0.35 

0.16 

0.21 

-0.20 

8 

17 

40368 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.03 

8 

17 

40368 

A 

1 

12 

20 

1.60 

0.28 

0.86 

0.40 

8 

17 

40368 

B 

0 

10 

17 

0.54 

0.30 

0.87 

-0.05 

8 

17 

40368 

C 

0 

22 

37 

0.52 

0.24 

1.15 

-0.10 

8 

17 

40368 

D 

0 

16 

27 

0.25 

0.31 

0.77 

-0.22 

8 

18 

41050 

* 

-1 

1835 

38 

1.36 

0.03 

0.00 

0.22 

8 

18 

41050 

A 

1 

2676 

88 

0.98 

0.02 

0.92 

0.41 

8 

18 

41050 

B 

0 

75 

2 

-0.41 

0.13 

1.20 

-0.14 

8 

18 

41050 

C 

0 

153 

5 

-0.47 

0.08 

0.70 

-0.22 

8 

18 

41050 

D 

0 

145 

5 

-0.99 

0.13 

0.59 

-0.30 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

19 

41025 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.04 

8 

19 

41025 

A 

1 

41 

82 

0.96 

0.19 

0.81 

0.57 

8 

19 

41025 

B 

0 

3 

6 

-0.60 

0.40 

0.52 

-0.18 

8 

19 

41025 

C 

0 

3 

6 

-1.51 

0.48 

0.23 

-0.33 

8 

19 

41025 

D 

0 

3 

6 

-2.11 

1.88 

0.74 

-0.42 

8 

20 

40106 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

8 

20 

40106 

A 

1 

42 

81 

1.13 

0.18 

0.85 

0.60 

8 

20 

40106 

B 

0 

3 

6 

-0.19 

0.07 

0.61 

-0.15 

8 

20 

40106 

C 

0 

5 

10 

-1.05 

0.48 

0.37 

-0.39 

8 

20 

40106 

D 

0 

2 

4 

-2.48 

1.04 

0.17 

-0.44 

8 

21 

41154 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

8 

21 

41154 

A 

1 

43 

80 

1.06 

0.20 

1.13 

0.33 

8 

21 

41154 

B 

0 

4 

7 

0.19 

0.41 

0.98 

-0.15 

8 

21 

41154 

C 

0 

1 

2 

0.43 

0.00 

0.97 

-0.05 

8 

21 

41154 

D 

0 

6 

11 

-0.12 

0.39 

0.77 

-0.28 

8 

22 

40137 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

8 

22 

40137 

A 

1 

43 

75 

1.07 

0.15 

0.83 

0.55 

8 

22 

40137 

B 

0 

1 

2 

0.46 

0.00 

0.96 

-0.02 

8 

22 

40137 

C 

0 

5 

9 

-0.07 

0.35 

0.74 

-0.17 

8 

22 

40137 

D 

0 

8 

14 

-1.09 

0.65 

0.45 

-0.53 

8 

23 

40342 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

8 

23 

40342 

A 

1 

34 

62 

1.08 

0.20 

0.85 

0.56 

8 

23 

40342 

B 

0 

3 

5 

0.89 

0.48 

2.22 

0.07 

8 

23 

40342 

C 

0 

6 

11 

-0.99 

0.30 

0.34 

-0.38 

8 

23 

40342 

D 

0 

12 

22 

-0.59 

0.34 

0.97 

-0.41 

8 

24 

40578 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

8 

24 

40578 

A 

1 

36 

64 

1.26 

0.19 

1.08 

0.41 

8 

24 

40578 

B 

0 

10 

18 

0.68 

0.31 

1.27 

-0.09 

8 

24 

40578 

C 

0 

2 

4 

0.18 

0.03 

0.57 

-0.12 

8 

24 

40578 

D 

0 

8 

14 

-0.20 

0.26 

0.48 

-0.39 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

25 

40760 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

8 

25 

40760 

A 

1 

28 

51 

1.41 

0.20 

0.84 

0.56 

8 

25 

40760 

B 

0 

6 

11 

0.20 

0.40 

0.83 

-0.07 

8 

25 

40760 

C 

0 

3 

5 

0.68 

0.21 

1.02 

0.02 

8 

25 

40760 

D 

0 

18 

33 

-0.77 

0.42 

0.59 

-0.56 

8 

26 

41161 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

8 

26 

41161 

A 

1 

25 

45 

1.06 

0.24 

1.06 

0.28 

8 

26 

41161 

B 

0 

3 

5 

-0.81 

0.34 

0.26 

-0.29 

8 

26 

41161 

C 

0 

4 

7 

0.85 

0.74 

2.09 

0.04 

8 

26 

41161 

D 

0 

23 

42 

0.44 

0.24 

1.96 

-0.17 

8 

27 

4MD48 

* 

-1 

4793 

98 

1.00 

0.02 

0.00 

-0.01 

8 

27 

4MD48 

A 

1 

30 

33 

1.79 

0.19 

0.82 

0.52 

8 

27 

4MD48 

B 

0 

20 

22 

0.49 

0.15 

0.67 

-0.33 

8 

27 

4MD48 

C 

0 

41 

45 

0.86 

0.11 

0.90 

-0.22 

8 

27 

4MD48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

28 

4G225 

* 

-1 

4764 

98 

0.98 

0.02 

0.00 

-0.07 

8 

28 

4G225 

A 

1 

94 

78 

1.79 

0.13 

1.05 

0.28 

8 

28 

4G225 

B 

0 

13 

11 

0.84 

0.34 

1.23 

-0.21 

8 

28 

4G225 

C 

0 

13 

11 

1.01 

0.23 

1.14 

-0.16 

8 

28 

4G225 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

29 

4G118 

* 

-1 

4768 

98 

1.00 

0.02 

0.00 

-0.01 

8 

29 

4G118 

A 

1 

75 

65 

1.25 

0.08 

1.00 

0.33 

8 

29 

4G118 

B 

0 

23 

20 

0.81 

0.13 

1.06 

-0.16 

8 

29 

4G118 

C 

0 

18 

16 

0.61 

0.20 

0.97 

-0.25 

8 

29 

4G118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

30 

4G328 

* 

-1 

4692 

96 

0.98 

0.02 

0.00 

-0.08 

8 

30 

4G328 

A 

1 

108 

56 

1.76 

0.09 

1.04 

0.29 

8 

30 

4G328 

B 

0 

2 

1 

-0.25 

0.55 

0.21 

-0.20 

8 

30 

4G328 

C 

0 

82 

43 

1.26 

0.09 

1.12 

-0.25 

8 

30 

4G328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


129 

Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

1 

40A513 

* 

-1 

4765 

98 

0.99 

0.02 

0.00 

-0.04 

9 

1 

40A513 

A 

1 

94 

79 

1.54 

0.08 

0.87 

0.51 

9 

1 

40A513 

B 

0 

12 

10 

0.42 

0.23 

0.66 

-0.34 

9 

1 

40A513 

C 

0 

13 

11 

0.49 

0.17 

0.66 

-0.33 

9 

1 

40A513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

2 

40A23 

* 

-1 

4780 

98 

0.98 

0.02 

0.00 

-0.10 

9 

2 

40A23 

A 

1 

73 

70 

2.03 

0.10 

0.99 

0.32 

9 

2 

40A23 

B 

0 

20 

19 

1.52 

0.20 

1.23 

-0.17 

9 

2 

40A23 

C 

0 

11 

11 

1.13 

0.20 

0.71 

-0.26 

9 

2 

40A23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

3 

40A516 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

9 

3 

40A516 

A 

1 

43 

47 

2.07 

0.14 

0.89 

0.54 

9 

3 

40A516 

B 

0 

27 

30 

0.93 

0.08 

0.59 

-0.45 

9 

3 

40A516 

C 

0 

21 

23 

1.30 

0.15 

0.93 

-0.16 

9 

3 

40A516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

4 

4NBT69 

* 

-1 

4795 

98 

1.00 

0.02 

0.00 

-0.01 

9 

4 

4NBT69 

A 

1 

56 

63 

1.35 

0.13 

1.01 

0.35 

9 

4 

4NBT69 

B 

0 

10 

11 

0.72 

0.19 

0.90 

-0.14 

9 

4 

4NBT69 

C 

0 

23 

26 

0.64 

0.16 

0.97 

-0.28 

9 

4 

4NBT69 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

5 

4NBT511 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

9 

5 

4NBT511 

A 

1 

72 

70 

1.98 

0.12 

0.99 

0.36 

9 

5 

4NBT511 

B 

0 

12 

12 

1.14 

0.16 

0.76 

-0.21 

9 

5 

4NBT511 

C 

0 

19 

18 

1.19 

0.22 

1.12 

-0.25 

9 

5 

4NBT511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

6 

40622 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.01 

9 

6 

40622 

A 

1 

24 

41 

1.88 

0.29 

0.76 

0.54 

9 

6 

40622 

B 

0 

18 

31 

0.38 

0.27 

1.13 

-0.19 

9 

6 

40622 

C 

0 

7 

12 

0.02 

0.43 

0.68 

-0.19 

9 

6 

40622 

D 

0 

10 

17 

-0.23 

0.56 

0.73 

-0.30 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

7 

40238 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

9 

7 

40238 

A 

1 

46 

81 

1.10 

0.16 

0.86 

0.38 

9 

7 

40238 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

7 

40238 

C 

0 

2 

4 

-0.27 

1.41 

0.96 

-0.19 

9 

7 

40238 

D 

0 

9 

16 

0.03 

0.35 

1.07 

-0.32 

9 

8 

40087 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

9 

8 

40087 

A 

1 

37 

67 

1.09 

0.20 

0.94 

0.55 

9 

8 

40087 

B 

0 

5 

9 

-0.59 

0.37 

0.55 

-0.31 

9 

8 

40087 

C 

0 

6 

11 

-0.14 

0.26 

0.77 

-0.21 

9 

8 

40087 

D 

0 

7 

13 

-0.43 

0.19 

0.52 

-0.32 

9 

9 

4NF16 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

9 

9 

4NF16 

A 

1 

78 

81 

1.56 

0.12 

1.04 

0.24 

9 

9 

4NF16 

B 

0 

4 

4 

0.80 

0.20 

0.73 

-0.14 

9 

9 

4NF16 

C 

0 

14 

15 

0.99 

0.13 

0.92 

-0.19 

9 

9 

4NF16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

10 

40207 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.01 

9 

10 

40207 

A 

1 

37 

64 

1.09 

0.17 

1.11 

0.27 

9 

10 

40207 

B 

0 

8 

14 

0.88 

0.45 

2.16 

0.00 

9 

10 

40207 

C 

0 

3 

5 

-0.75 

0.33 

0.26 

-0.35 

9 

10 

40207 

D 

0 

10 

17 

0.53 

0.32 

1.41 

-0.14 

9 

11 

40208 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

9 

11 

40208 

A 

1 

28 

52 

1.12 

0.27 

1.14 

0.40 

9 

11 

40208 

B 

0 

5 

9 

-0.04 

0.30 

0.68 

-0.12 

9 

11 

40208 

C 

0 

11 

20 

0.51 

0.41 

2.31 

-0.01 

9 

11 

40208 

D 

0 

10 

19 

-0.84 

0.53 

0.57 

-0.42 

9 

12 

4NF43 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

9 

12 

4NF43 

A 

1 

72 

65 

1.71 

0.10 

1.05 

0.27 

9 

12 

4NF43 

B 

0 

15 

14 

0.66 

0.17 

0.57 

-0.39 

9 

12 

4NF43 

C 

0 

23 

21 

1.55 

0.19 

1.68 

0.01 

9 

12 

4NF43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

13 

4NF311 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

9 

13 

4NF311 

A 

1 

67 

64 

1.97 

0.14 

1.04 

0.34 

9 

13 

4NF311 

B 

0 

19 

18 

1.45 

0.18 

1.24 

-0.10 

9 

13 

4NF311 

C 

0 

19 

18 

0.90 

0.14 

0.67 

-0.33 

9 

13 

4NF311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

14 

4NF15 

* 

-1 

4772 

98 

0.99 

0.02 

0.00 

-0.06 

9 

14 

4NF15 

A 

1 

60 

54 

1.96 

0.10 

0.84 

0.49 

9 

14 

4NF15 

B 

0 

22 

20 

1.03 

0.18 

0.86 

-0.27 

9 

14 

4NF15 

C 

0 

30 

27 

1.08 

0.15 

0.89 

-0.30 

9 

14 

4NF15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

15 

40537 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

9 

15 

40537 

A 

1 

18 

36 

1.54 

0.19 

0.79 

0.48 

9 

15 

40537 

B 

0 

4 

8 

0.66 

0.65 

1.23 

-0.05 

9 

15 

40537 

C 

0 

18 

36 

0.46 

0.22 

0.92 

-0.28 

9 

15 

40537 

D 

0 

10 

20 

0.43 

0.37 

0.89 

-0.20 

9 

16 

40389 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

-0.02 

9 

16 

40389 

A 

1 

19 

35 

1.97 

0.27 

0.92 

0.47 

9 

16 

40389 

B 

0 

7 

13 

0.86 

0.42 

1.05 

-0.11 

9 

16 

40389 

C 

0 

21 

38 

0.81 

0.24 

0.98 

-0.27 

9 

16 

40389 

D 

0 

8 

15 

0.75 

0.28 

0.73 

-0.16 

9 

17 

4NF519 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

9 

17 

4NF519 

A 

1 

24 

27 

1.97 

0.27 

1.20 

0.32 

9 

17 

4NF519 

B 

0 

14 

16 

0.88 

0.19 

0.66 

-0.25 

9 

17 

4NF519 

C 

0 

51 

57 

1.37 

0.11 

1.15 

-0.10 

9 

17 

4NF519 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

18 

40148 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

9 

18 

40148 

A 

1 

49 

86 

0.86 

0.14 

0.87 

0.50 

9 

18 

40148 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

18 

40148 

C 

0 

6 

11 

-0.24 

0.50 

1.00 

-0.21 

9 

18 

40148 

D 

0 

2 

4 

-3.66 

1.69 

0.10 

-0.60 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

19 

40041 

* 

-1 

4622 

95 

0.98 

0.02 

0.00 

-0.06 

9 

19 

40041 

A 

1 

240 

92 

1.44 

0.06 

0.95 

0.35 

9 

19 

40041 

B 

0 

15 

6 

0.55 

0.19 

0.85 

-0.19 

9 

19 

40041 

C 

0 

5 

2 

-0.37 

0.22 

0.30 

-0.23 

9 

19 

40041 

D 

0 

2 

1 

-1.44 

0.53 

0.10 

-0.24 

9 

20 

40571 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.01 

9 

20 

40571 

A 

1 

50 

86 

1.01 

0.16 

1.13 

0.18 

9 

20 

40571 

B 

0 

8 

14 

0.45 

0.13 

0.90 

-0.18 

9 

20 

40571 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

20 

40571 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

21 

40734 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.02 

9 

21 

40734 

A 

1 

40 

78 

0.83 

0.20 

1.68 

0.19 

9 

21 

40734 

B 

0 

2 

4 

1.23 

0.32 

2.41 

0.08 

9 

21 

40734 

C 

0 

5 

10 

0.65 

0.22 

1.42 

-0.02 

9 

21 

40734 

D 

0 

4 

8 

-0.68 

0.85 

0.77 

-0.33 

9 

22 

40878 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

9 

22 

40878 

A 

1 

40 

74 

1.18 

0.18 

0.85 

0.57 

9 

22 

40878 

B 

0 

2 

4 

0.55 

0.25 

1.14 

-0.01 

9 

22 

40878 

C 

0 

4 

7 

-0.65 

0.61 

0.54 

-0.23 

9 

22 

40878 

D 

0 

8 

15 

-1.33 

0.73 

0.52 

-0.52 

9 

23 

40598 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

-0.02 

9 

23 

40598 

A 

1 

37 

77 

1.36 

0.17 

1.16 

0.21 

9 

23 

40598 

B 

0 

2 

4 

1.08 

0.15 

1.06 

-0.04 

9 

23 

40598 

C 

0 

7 

15 

0.97 

0.22 

1.06 

-0.12 

9 

23 

40598 

D 

0 

2 

4 

0.32 

0.19 

0.50 

-0.20 

9 

24 

41199 

* 

-1 

4814 

99 

1.00 

0.02 

0.00 

0.02 

9 

24 

41199 

A 

1 

45 

64 

1.29 

0.14 

0.90 

0.47 

9 

24 

41199 

B 

0 

5 

7 

0.71 

0.60 

1.63 

-0.02 

9 

24 

41199 

C 

0 

10 

14 

0.23 

0.31 

0.92 

-0.16 

9 

24 

41199 

D 

0 

10 

14 

-0.80 

0.68 

0.59 

-0.47 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

25 

41092 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

-0.01 

9 

25 

41092 

A 

1 

28 

57 

1.86 

0.31 

0.74 

0.57 

9 

25 

41092 

B 

0 

8 

16 

0.14 

0.26 

0.72 

-0.28 

9 

25 

41092 

C 

0 

7 

14 

-0.12 

0.20 

0.50 

-0.33 

9 

25 

41092 

D 

0 

6 

12 

0.32 

0.12 

0.72 

-0.19 

9 

26 

4MD49 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.05 

9 

26 

4MD49 

A 

1 

59 

62 

1.68 

0.12 

1.08 

0.26 

9 

26 

4MD49 

B 

0 

16 

17 

1.04 

0.19 

0.96 

-0.22 

9 

26 

4MD49 

C 

0 

20 

21 

1.31 

0.19 

1.34 

-0.10 

9 

26 

4MD49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

27 

4MD31 

* 

-1 

4772 

98 

0.99 

0.02 

0.00 

-0.06 

9 

27 

4MD31 

A 

1 

48 

43 

2.02 

0.12 

0.90 

0.46 

9 

27 

4MD31 

B 

0 

28 

25 

1.17 

0.16 

0.93 

-0.23 

9 

27 

4MD31 

C 

0 

36 

32 

1.18 

0.13 

0.90 

-0.27 

9 

27 

4MD31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

28 

4G215 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.06 

9 

28 

4G215 

A 

1 

76 

79 

1.66 

0.11 

0.99 

0.32 

9 

28 

4G215 

B 

0 

5 

5 

1.15 

0.19 

0.94 

-0.09 

9 

28 

4G215 

C 

0 

15 

16 

0.86 

0.18 

0.84 

-0.30 

9 

28 

4G215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

29 

4G331 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

9 

29 

4G331 

A 

1 

78 

76 

1.87 

0.13 

1.17 

0.22 

9 

29 

4G331 

B 

0 

18 

17 

1.37 

0.15 

1.06 

-0.17 

9 

29 

4G331 

C 

0 

7 

7 

1.25 

0.19 

0.86 

-0.13 

9 

29 

4G331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

30 

4G218 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

9 

30 

4G218 

A 

1 

62 

56 

1.69 

0.12 

1.30 

0.20 

9 

30 

4G218 

B 

0 

6 

5 

1.64 

0.21 

1.28 

0.03 

9 

30 

4G218 

C 

0 

42 

38 

1.29 

0.11 

1.07 

-0.22 

9 

30 

4G218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

1 

41075 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

10 

1 

41075 

A 

1 

39 

72 

1.22 

0.15 

0.89 

0.46 

10 

1 

41075 

B 

0 

5 

9 

0.06 

0.33 

0.63 

-0.28 

10 

1 

41075 

C 

0 

5 

9 

0.61 

0.31 

1.01 

-0.10 

10 

1 

41075 

D 

0 

5 

9 

-0.14 

0.55 

0.64 

-0.34 

10 

2 

40A32 

* 

-1 

4764 

98 

0.98 

0.02 

0.00 

-0.07 

10 

2 

40A32 

A 

1 

76 

63 

2.06 

0.15 

1.06 

0.47 

10 

2 

40A32 

B 

0 

14 

12 

0.80 

0.28 

1.05 

-0.23 

10 

2 

40A32 

C 

0 

30 

25 

0.82 

0.13 

0.74 

-0.36 

10 

2 

40A32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

3 

40A312 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

10 

3 

40A312 

A 

1 

39 

41 

1.83 

0.17 

1.21 

0.30 

10 

3 

40A312 

B 

0 

33 

35 

1.10 

0.12 

0.80 

-0.32 

10 

3 

40A312 

C 

0 

22 

23 

1.52 

0.16 

1.26 

0.01 

10 

3 

40A312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

4 

4NBT19 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.08 

10 

4 

4NBT19 

A 

1 

81 

74 

1.93 

0.11 

0.95 

0.37 

10 

4 

4NBT19 

B 

0 

7 

6 

1.66 

0.29 

1.56 

-0.01 

10 

4 

4NBT19 

C 

0 

22 

20 

0.84 

0.18 

0.74 

-0.41 

10 

4 

4NBT19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

5 

4NBT44 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.05 

10 

5 

4NBT44 

A 

1 

58 

64 

1.77 

0.14 

0.94 

0.45 

10 

5 

4NBT44 

B 

0 

15 

17 

0.74 

0.11 

0.64 

-0.31 

10 

5 

4NBT44 

C 

0 

17 

19 

0.92 

0.13 

0.81 

-0.25 

10 

5 

4NBT44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

6 

4NBT68 

* 

-1 

4765 

98 

0.99 

0.02 

0.00 

-0.04 

10 

6 

4NBT68 

A 

1 

58 

49 

1.70 

0.11 

1.06 

0.43 

10 

6 

4NBT68 

B 

0 

21 

18 

0.87 

0.13 

0.75 

-0.24 

10 

6 

4NBT68 

C 

0 

40 

34 

0.99 

0.12 

0.95 

-0.26 

10 

6 

4NBT68 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

7 

4NF72 

* 

-1 

4781 

98 

0.99 

0.02 

0.00 

-0.03 

10 

7 

4NF72 

A 

1 

88 

85 

1.39 

0.10 

0.98 

0.35 

10 

7 

4NF72 

B 

0 

10 

10 

0.40 

0.31 

0.92 

-0.27 

10 

7 

4NF72 

C 

0 

5 

5 

0.34 

0.27 

0.65 

-0.20 

10 

7 

4NF72 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

8 

4NF79 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

10 

8 

4NF79 

A 

1 

92 

84 

1.61 

0.09 

1.08 

0.21 

10 

8 

4NF79 

B 

0 

17 

15 

1.11 

0.19 

1.15 

-0.20 

10 

8 

4NF79 

C 

0 

1 

1 

1.27 

0.00 

0.98 

-0.03 

10 

8 

4NF79 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

9 

40808 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

10 

9 

40808 

A 

1 

39 

70 

1.04 

0.17 

1.20 

0.43 

10 

9 

40808 

B 

0 

7 

13 

-0.27 

0.29 

0.58 

-0.35 

10 

9 

40808 

C 

0 

4 

7 

0.04 

0.47 

0.82 

-0.18 

10 

9 

40808 

D 

0 

6 

11 

0.36 

0.23 

0.94 

-0.12 

10 

10 

40514 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

10 

10 

40514 

A 

1 

30 

61 

1.08 

0.27 

1.47 

0.26 

10 

10 

40514 

B 

0 

10 

20 

0.84 

0.24 

1.61 

0.01 

10 

10 

40514 

C 

0 

5 

10 

-0.30 

0.24 

0.47 

-0.29 

10 

10 

40514 

D 

0 

4 

8 

0.06 

0.32 

0.68 

-0.17 

10 

11 

40084 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.04 

10 

11 

40084 

A 

1 

31 

52 

1.32 

0.19 

0.66 

0.62 

10 

11 

40084 

B 

0 

7 

12 

-0.04 

0.27 

0.71 

-0.14 

10 

11 

40084 

C 

0 

4 

7 

-0.94 

0.47 

0.34 

-0.28 

10 

11 

40084 

D 

0 

18 

30 

-0.37 

0.30 

0.71 

-0.42 

10 

12 

40523 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

10 

12 

40523 

A 

1 

26 

47 

1.77 

0.21 

0.52 

0.72 

10 

12 

40523 

B 

0 

15 

27 

-0.02 

0.26 

0.84 

-0.30 

10 

12 

40523 

C 

0 

3 

5 

-0.68 

0.33 

0.29 

-0.23 

10 

12 

40523 

D 

0 

11 

20 

-0.53 

0.25 

0.43 

-0.43 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

13 

40083 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

10 

13 

40083 

A 

1 

27 

48 

1.48 

0.26 

1.19 

0.41 

10 

13 

40083 

B 

0 

7 

13 

-0.51 

0.75 

0.71 

-0.37 

10 

13 

40083 

C 

0 

10 

18 

0.65 

0.36 

1.72 

-0.07 

10 

13 

40083 

D 

0 

12 

21 

0.51 

0.20 

0.85 

-0.13 

10 

14 

40954 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

10 

14 

40954 

A 

1 

21 

38 

1.21 

0.20 

0.98 

0.38 

10 

14 

40954 

B 

0 

15 

27 

0.73 

0.23 

1.36 

0.01 

10 

14 

40954 

C 

0 

8 

15 

0.54 

0.35 

1.05 

-0.07 

10 

14 

40954 

D 

0 

11 

20 

-0.10 

0.30 

0.54 

-0.40 

10 

15 

40522 

* 

-1 

4831 

99 

0.99 

0.02 

0.00 

-0.02 

10 

15 

40522 

A 

1 

23 

43 

2.23 

0.27 

0.74 

0.62 

10 

15 

40522 

B 

0 

9 

17 

0.33 

0.19 

0.46 

-0.33 

10 

15 

40522 

C 

0 

16 

30 

0.83 

0.21 

0.96 

-0.23 

10 

15 

40522 

D 

0 

5 

9 

0.18 

0.59 

0.60 

-0.27 

10 

16 

4NF513 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

10 

16 

4NF513 

A 

1 

26 

29 

1.79 

0.21 

0.91 

0.47 

10 

16 

4NF513 

B 

0 

52 

58 

0.88 

0.11 

0.98 

-0.26 

10 

16 

4NF513 

C 

0 

12 

13 

0.48 

0.18 

0.55 

-0.25 

10 

16 

4NF513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

17 

4NF714 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

10 

17 

4NF714 

A 

1 

27 

30 

2.41 

0.20 

0.63 

0.64 

10 

17 

4NF714 

B 

0 

14 

16 

1.34 

0.22 

1.15 

-0.05 

10 

17 

4NF714 

C 

0 

48 

54 

0.94 

0.08 

0.65 

-0.55 

10 

17 

4NF714 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

18 

40013 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

10 

18 

40013 

A 

1 

45 

88 

1.22 

0.23 

1.18 

0.39 

10 

18 

40013 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

18 

40013 

C 

0 

3 

6 

-0.73 

0.96 

0.70 

-0.26 

10 

18 

40013 

D 

0 

3 

6 

-0.81 

0.22 

0.38 

-0.27 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

19 

4MD47 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

10 

19 

4MD47 

A 

1 

111 

92 

1.37 

0.08 

0.93 

0.28 

10 

19 

4MD47 

B 

0 

2 

2 

0.05 

0.47 

0.43 

-0.19 

10 

19 

4MD47 

C 

0 

8 

7 

0.60 

0.48 

1.55 

-0.21 

10 

19 

4MD47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

20 

40263 

* 

-1 

4841 

99 

1.00 

0.02 

0.00 

0.00 

10 

20 

40263 

A 

1 

37 

86 

1.12 

0.19 

0.95 

0.25 

10 

20 

40263 

B 

0 

1 

2 

1.10 

0.00 

1.71 

0.01 

10 

20 

40263 

C 

0 

2 

5 

0.77 

1.23 

2.30 

-0.04 

10 

20 

40263 

D 

0 

3 

7 

-0.42 

0.92 

0.89 

-0.32 

10 

21 

40252 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

10 

21 

40252 

A 

1 

44 

79 

1.00 

0.22 

1.40 

0.29 

10 

21 

40252 

B 

0 

9 

16 

-0.16 

0.23 

0.78 

-0.30 

10 

21 

40252 

C 

0 

2 

4 

0.38 

0.19 

1.06 

-0.06 

10 

21 

40252 

D 

0 

1 

2 

0.88 

0.00 

1.72 

0.01 

10 

22 

40718 

* 

-1 

4838 

99 

1.00 

0.02 

0.00 

-0.02 

10 

22 

40718 

A 

1 

38 

83 

1.46 

0.18 

0.99 

0.43 

10 

22 

40718 

B 

0 

1 

2 

0.01 

0.00 

0.43 

-0.16 

10 

22 

40718 

C 

0 

4 

9 

-0.39 

0.11 

0.29 

-0.44 

10 

22 

40718 

D 

0 

3 

7 

0.95 

0.28 

1.18 

-0.06 

10 

23 

40879 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

10 

23 

40879 

A 

1 

37 

66 

1.08 

0.18 

0.92 

0.46 

10 

23 

40879 

B 

0 

7 

13 

0.36 

0.46 

1.68 

-0.11 

10 

23 

40879 

C 

0 

4 

7 

-0.65 

0.50 

0.49 

-0.31 

10 

23 

40879 

D 

0 

8 

14 

-0.15 

0.35 

0.81 

-0.29 

10 

24 

40329 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.00 

10 

24 

40329 

A 

1 

43 

66 

1.46 

0.18 

1.00 

0.43 

10 

24 

40329 

B 

0 

14 

22 

0.80 

0.38 

2.09 

-0.08 

10 

24 

40329 

C 

0 

3 

5 

-0.92 

0.80 

0.27 

-0.30 

10 

24 

40329 

D 

0 

5 

8 

-1.00 

0.42 

0.23 

-0.41 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

25 

41008 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

10 

25 

41008 

A 

1 

30 

55 

1.11 

0.26 

1.55 

0.26 

10 

25 

41008 

B 

0 

8 

15 

0.78 

0.44 

1.63 

-0.01 

10 

25 

41008 

C 

0 

10 

18 

0.35 

0.23 

0.84 

-0.18 

10 

25 

41008 

D 

0 

7 

13 

0.29 

0.22 

0.75 

-0.17 

10 

26 

41006 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.01 

10 

26 

41006 

A 

1 

30 

49 

1.29 

0.24 

1.25 

0.33 

10 

26 

41006 

B 

0 

3 

5 

0.21 

0.30 

0.59 

-0.12 

10 

26 

41006 

C 

0 

15 

25 

0.49 

0.34 

1.32 

-0.17 

10 

26 

41006 

D 

0 

13 

21 

0.49 

0.24 

1.07 

-0.16 

10 

27 

41037 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.04 

10 

27 

41037 

A 

1 

14 

26 

1.10 

0.30 

1.52 

0.27 

10 

27 

41037 

B 

0 

33 

62 

0.64 

0.16 

1.22 

0.12 

10 

27 

41037 

C 

0 

2 

4 

-1.13 

1.34 

0.28 

-0.25 

10 

27 

41037 

D 

0 

4 

8 

-1.72 

0.95 

0.21 

-0.49 

10 

28 

4G324 

* 

-1 

4762 

98 

0.98 

0.02 

0.00 

-0.07 

10 

28 

4G324 

A 

1 

95 

78 

1.86 

0.13 

0.99 

0.40 

10 

28 

4G324 

B 

0 

11 

9 

0.55 

0.26 

0.69 

-0.25 

10 

28 

4G324 

C 

0 

16 

13 

0.68 

0.21 

0.84 

-0.28 

10 

28 

4G324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

29 

4G24 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

10 

29 

4G24 

A 

1 

67 

74 

1.72 

0.11 

1.04 

0.31 

10 

29 

4G24 

B 

0 

5 

5 

0.65 

0.19 

0.51 

-0.24 

10 

29 

4G24 

C 

0 

19 

21 

1.19 

0.21 

1.76 

-0.21 

10 

29 

4G24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

30 

4G19 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

10 

30 

4G19 

A 

1 

51 

49 

1.68 

0.14 

1.09 

0.44 

10 

30 

4G19 

B 

0 

34 

33 

0.80 

0.15 

0.88 

-0.31 

10 

30 

4G19 

C 

0 

19 

18 

0.84 

0.16 

0.83 

-0.19 

10 

30 

4G19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

1 

40A416 

* 

-1 

4765 

98 

0.98 

0.02 

0.00 

-0.08 

BMF 

1 

40A416 

A 

1 

99 

83 

1.87 

0.12 

0.87 

0.46 

BMF 

1 

40A416 

B 

0 

6 

5 

0.33 

0.34 

0.56 

-0.23 

BMF 

1 

40A416 

C 

0 

14 

12 

0.32 

0.19 

0.53 

-0.37 

BMF 

1 

40A416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

2 

40A29 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

BMF 

2 

40A29 

A 

1 

57 

62 

1.96 

0.11 

0.82 

0.51 

BMF 

2 

40A29 

B 

0 

11 

12 

0.78 

0.17 

0.60 

-0.31 

BMF 

2 

40A29 

C 

0 

24 

26 

1.04 

0.17 

0.95 

-0.34 

BMF 

2 

40A29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

3 

40A57 

* 

-1 

4795 

98 

0.98 

0.02 

0.00 

-0.09 

BMF 

3 

40A57 

A 

1 

50 

56 

2.21 

0.13 

0.99 

0.42 

BMF 

3 

40A57 

B 

0 

9 

10 

1.28 

0.23 

0.74 

-0.21 

BMF 

3 

40A57 

C 

0 

30 

34 

1.48 

0.12 

0.89 

-0.31 

BMF 

3 

40A57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

4 

40763 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

BMF 

4 

40763 

A 

1 

30 

58 

1.38 

0.15 

0.77 

0.61 

BMF 

4 

40763 

B 

0 

2 

4 

0.70 

0.54 

1.09 

-0.02 

BMF 

4 

40763 

C 

0 

14 

27 

0.13 

0.28 

0.79 

-0.38 

BMF 

4 

40763 

D 

0 

6 

12 

-0.42 

0.17 

0.33 

-0.41 

BMF 

5 

4NBT11 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

BMF 

5 

4NBT11 

A 

1 

75 

69 

1.95 

0.13 

0.98 

0.39 

BMF 

5 

4NBT11 

B 

0 

12 

11 

0.96 

0.18 

0.75 

-0.23 

BMF 

5 

4NBT11 

C 

0 

22 

20 

1.07 

0.14 

0.85 

-0.27 

BMF 

5 

4NBT11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

6 

4NBT14 

* 

-1 

4772 

98 

0.99 

0.02 

0.00 

-0.06 

BMF 

6 

4NBT14 

A 

1 

61 

54 

1.84 

0.11 

0.99 

0.36 

BMF 

6 

4NBT14 

B 

0 

30 

27 

1.35 

0.15 

1.24 

-0.12 

BMF 

6 

4NBT14 

C 

0 

21 

19 

0.92 

0.19 

0.81 

-0.33 

BMF 

6 

4NBT14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

7 

4NF713 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

BMF 

7 

4NF713 

A 

1 

97 

88 

1.66 

0.08 

0.92 

0.40 

BMF 

7 

4NF713 

B 

0 

3 

3 

0.47 

0.71 

0.75 

-0.20 

BMF 

7 

4NF713 

C 

0 

10 

9 

0.59 

0.20 

0.63 

-0.33 

BMF 

7 

4NF713 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

8 

4NF25 

* 

-1 

4770 

98 

1.00 

0.02 

0.00 

-0.01 

BMF 

8 

4NF25 

A 

1 

90 

79 

1.20 

0.07 

0.92 

0.41 

BMF 

8 

4NF25 

B 

0 

8 

7 

0.55 

0.23 

0.89 

-0.18 

BMF 

8 

4NF25 

C 

0 

16 

14 

0.40 

0.19 

0.78 

-0.35 

BMF 

8 

4NF25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

9 

40955 

* 

-1 

4828 

99 

0.99 

0.02 

0.00 

-0.02 

BMF 

9 

40955 

A 

1 

42 

75 

1.63 

0.22 

0.93 

0.46 

BMF 

9 

40955 

B 

0 

5 

9 

0.24 

0.34 

0.71 

-0.23 

BMF 

9 

40955 

C 

0 

6 

11 

0.41 

0.34 

0.81 

-0.21 

BMF 

9 

40955 

D 

0 

3 

5 

-0.53 

0.13 

0.26 

-0.30 

BMF 

10 

40512 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

BMF 

10 

40512 

A 

1 

33 

59 

1.00 

0.16 

0.86 

0.49 

BMF 

10 

40512 

B 

0 

3 

5 

-0.32 

0.93 

0.78 

-0.21 

BMF 

10 

40512 

C 

0 

15 

27 

0.12 

0.19 

0.85 

-0.27 

BMF 

10 

40512 

D 

0 

5 

9 

-0.32 

0.49 

0.73 

-0.27 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

11 

40215 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.05 

BMF 

11 

40215 

A 

1 

27 

48 

1.08 

0.27 

1.21 

0.49 

BMF 

11 

40215 

B 

0 

4 

7 

0.22 

0.55 

1.22 

-0.05 

BMF 

11 

40215 

C 

0 

8 

14 

-0.35 

0.22 

0.55 

-0.26 

BMF 

11 

40215 

D 

0 

17 

30 

-0.12 

0.19 

0.75 

-0.30 

BMF 

12 

40052 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

BMF 

12 

40052 

A 

1 

29 

53 

1.58 

0.28 

0.91 

0.47 

BMF 

12 

40052 

B 

0 

4 

7 

0.63 

0.30 

1.02 

-0.06 

BMF 

12 

40052 

C 

0 

11 

20 

-0.13 

0.24 

0.56 

-0.39 

BMF 

12 

40052 

D 

0 

11 

20 

0.50 

0.32 

1.13 

-0.16 

BMF 

13 

40689 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

BMF 

13 

40689 

A 

1 

24 

44 

1.03 

0.20 

1.00 

0.40 

BMF 

13 

40689 

B 

0 

24 

44 

0.41 

0.17 

1.11 

-0.17 

BMF 

13 

40689 

C 

0 

2 

4 

0.20 

0.08 

0.66 

-0.08 

BMF 

13 

40689 

D 

0 

5 

9 

-0.47 

0.06 

0.34 

-0.35 

BMF 

14 

4NF12 

* 

-1 

4787 

98 

0.99 

0.02 

0.00 

-0.06 

BMF 

14 

4NF12 

A 

1 

51 

53 

1.74 

0.14 

1.12 

0.27 

BMF 

14 

4NF12 

B 

0 

27 

28 

1.18 

0.13 

0.92 

-0.21 

BMF 

14 

4NF12 

C 

0 

19 

20 

1.31 

0.22 

1.40 

-0.10 

BMF 

14 

4NF12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

15 

40219 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.05 

BMF 

15 

40219 

A 

1 

16 

29 

1.24 

0.37 

1.02 

0.41 

BMF 

15 

40219 

B 

0 

26 

46 

0.16 

0.19 

1.02 

-0.23 

BMF 

15 

40219 

C 

0 

3 

5 

0.05 

0.12 

0.61 

-0.08 

BMF 

15 

40219 

D 

0 

11 

20 

0.13 

0.31 

1.03 

-0.13 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

16 

40969 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

-0.01 

BMF 

16 

40969 

A 

1 

17 

30 

1.62 

0.35 

1.39 

0.32 

BMF 

16 

40969 

B 

0 

17 

30 

1.09 

0.17 

1.07 

0.01 

BMF 

16 

40969 

C 

0 

3 

5 

0.11 

0.30 

0.37 

-0.20 

BMF 

16 

40969 

D 

0 

20 

35 

0.72 

0.24 

1.12 

-0.22 

BMF 

17 

40068 

* 

-1 

1847 

38 

1.35 

0.03 

0.00 

0.22 

BMF 

17 

40068 

A 

1 

657 

22 

1.94 

0.06 

1.17 

0.46 

BMF 

17 

40068 

B 

0 

1435 

47 

0.62 

0.03 

1.01 

-0.11 

BMF 

17 

40068 

C 

0 

371 

12 

0.39 

0.06 

0.89 

-0.11 

BMF 

17 

40068 

D 

0 

574 

19 

0.10 

0.05 

0.66 

-0.25 

BMF 

18 

40559 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

-0.01 

BMF 

18 

40559 

A 

1 

47 

90 

1.22 

0.20 

0.99 

0.25 

BMF 

18 

40559 

B 

0 

4 

8 

-0.20 

0.60 

0.86 

-0.27 

BMF 

18 

40559 

C 

0 

1 

2 

1.04 

0.00 

1.73 

-0.01 

BMF 

18 

40559 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

19 

4MD52 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

BMF 

19 

4MD52 

A 

1 

86 

93 

1.65 

0.10 

0.98 

0.26 

BMF 

19 

4MD52 

B 

0 

1 

1 

1.01 

0.00 

0.79 

-0.06 

BMF 

19 

4MD52 

C 

0 

5 

5 

0.56 

0.26 

0.57 

-0.26 

BMF 

19 

4MD52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

20 

40610 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

BMF 

20 

40610 

A 

1 

43 

84 

1.08 

0.20 

0.89 

0.40 

BMF 

20 

40610 

B 

0 

2 

4 

-0.01 

0.64 

0.85 

-0.13 

BMF 

20 

40610 

C 

0 

4 

8 

-0.44 

0.59 

0.64 

-0.28 

BMF 

20 

40610 

D 

0 

2 

4 

-0.69 

0.10 

0.36 

-0.23 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

21 

41093 

* 

-1 

4838 

99 

1.00 

0.02 

0.00 

0.02 

BMF 

21 

41093 

A 

1 

36 

78 

1.12 

0.17 

0.79 

0.61 

BMF 

21 

41093 

B 

0 

2 

4 

-0.87 

0.45 

0.31 

-0.29 

BMF 

21 

41093 

C 

0 

4 

9 

-0.21 

0.32 

0.64 

-0.25 

BMF 

21 

41093 

D 

0 

4 

9 

-0.93 

0.28 

0.30 

-0.43 

BMF 

22 

40309 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

BMF 

22 

40309 

A 

1 

41 

76 

1.04 

0.17 

0.90 

0.47 

BMF 

22 

40309 

B 

0 

9 

17 

-0.12 

0.33 

0.84 

-0.32 

BMF 

22 

40309 

C 

0 

2 

4 

-0.21 

0.23 

0.55 

-0.16 

BMF 

22 

40309 

D 

0 

2 

4 

-0.90 

0.86 

0.37 

-0.27 

BMF 

23 

4MD54 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

BMF 

23 

4MD54 

A 

1 

67 

74 

1.27 

0.12 

0.97 

0.33 

BMF 

23 

4MD54 

B 

0 

18 

20 

0.57 

0.17 

0.94 

-0.27 

BMF 

23 

4MD54 

C 

0 

5 

6 

0.45 

0.35 

0.79 

-0.16 

BMF 

23 

4MD54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

24 

40427 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

BMF 

24 

40427 

A 

1 

32 

57 

0.83 

0.16 

0.96 

0.36 

BMF 

24 

40427 

B 

0 

11 

20 

0.15 

0.27 

1.02 

-0.16 

BMF 

24 

40427 

C 

0 

5 

9 

-0.19 

0.62 

0.93 

-0.21 

BMF 

24 

40427 

D 

0 

8 

14 

0.10 

0.41 

1.15 

-0.16 

BMF 

25 

40430 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.01 

BMF 

25 

40430 

A 

1 

35 

56 

1.30 

0.22 

0.98 

0.34 

BMF 

25 

40430 

B 

0 

8 

13 

0.87 

0.47 

2.35 

0.00 

BMF 

25 

40430 

C 

0 

4 

6 

0.53 

0.14 

0.84 

-0.06 

BMF 

25 

40430 

D 

0 

16 

25 

0.00 

0.38 

0.99 

-0.36 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

26 

40579 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.03 

BMF 

26 

40579 

A 

1 

28 

45 

1.22 

0.25 

1.07 

0.39 

BMF 

26 

40579 

B 

0 

13 

21 

0.03 

0.33 

1.09 

-0.24 

BMF 

26 

40579 

C 

0 

5 

8 

0.14 

0.43 

0.88 

-0.12 

BMF 

26 

40579 

D 

0 

16 

26 

0.33 

0.30 

1.74 

-0.14 

BMF 

27 

40109 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

BMF 

27 

40109 

A 

1 

16 

29 

1.32 

0.29 

1.29 

0.38 

BMF 

27 

40109 

B 

0 

26 

46 

0.54 

0.16 

1.06 

-0.13 

BMF 

27 

40109 

C 

0 

5 

9 

0.41 

0.40 

0.86 

-0.08 

BMF 

27 

40109 

D 

0 

9 

16 

0.13 

0.41 

0.78 

-0.23 

BMF 

28 

4G115 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

BMF 

28 

4G115 

A 

1 

67 

72 

1.28 

0.12 

1.02 

0.31 

BMF 

28 

4G115 

B 

0 

11 

12 

0.84 

0.24 

1.28 

-0.10 

BMF 

28 

4G115 

C 

0 

15 

16 

0.46 

0.14 

0.73 

-0.30 

BMF 

28 

4G115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

29 

4G330 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.06 

BMF 

29 

4G330 

A 

1 

65 

73 

1.84 

0.12 

0.95 

0.40 

BMF 

29 

4G330 

B 

0 

17 

19 

1.17 

0.17 

0.98 

-0.22 

BMF 

29 

4G330 

C 

0 

7 

8 

0.50 

0.17 

0.43 

-0.34 

BMF 

29 

4G330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

30 

4G226 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

BMF 

30 

4G226 

A 

1 

55 

52 

2.07 

0.16 

1.01 

0.36 

BMF 

30 

4G226 

B 

0 

5 

5 

0.41 

0.30 

0.38 

-0.26 

BMF 

30 

4G226 

C 

0 

45 

43 

1.36 

0.12 

1.11 

-0.26 

BMF 

30 

4G226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

31 

50  A3  4 

* 

-1 

4524 

95 

0.86 

0.02 

0.00 

-0.14 

BMF 

31 

50A34 

A 

1 

219 

92 

1.78 

0.07 

0.96 

0.27 

BMF 

31 

50A34 

B 

0 

12 

5 

0.76 

0.24 

0.85 

-0.19 

BMF 

31 

50A34 

C 

0 

6 

3 

0.33 

0.29 

0.51 

-0.19 

BMF 

31 

50A34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

32 

5NBT25 

* 

-1 

4667 

98 

0.89 

0.02 

0.00 

-0.06 

BMF 

32 

5NBT25 

A 

1 

77 

82 

1.66 

0.11 

0.91 

0.44 

BMF 

32 

5NBT25 

B 

0 

12 

13 

0.60 

0.11 

0.61 

-0.32 

BMF 

32 

5NBT25 

C 

0 

5 

5 

0.26 

0.15 

0.42 

-0.28 

BMF 

32 

5NBT25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

33 

50A11 

* 

-1 

4649 

98 

0.89 

0.02 

0.00 

-0.04 

BMF 

33 

50A11 

A 

1 

85 

76 

1.51 

0.10 

0.84 

0.49 

BMF 

33 

50A11 

B 

0 

20 

18 

0.41 

0.18 

0.82 

-0.37 

BMF 

33 

50A11 

C 

0 

7 

6 

0.14 

0.23 

0.50 

-0.27 

BMF 

33 

50A11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

34 

5G412 

* 

-1 

4637 

97 

0.88 

0.02 

0.00 

-0.08 

BMF 

34 

5G412 

A 

1 

85 

69 

1.83 

0.12 

1.02 

0.34 

BMF 

34 

5G412 

B 

0 

16 

13 

1.01 

0.13 

0.79 

-0.22 

BMF 

34 

5G412 

C 

0 

23 

19 

1.11 

0.11 

0.85 

-0.22 

BMF 

34 

5G412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

35 

5MD415 

* 

-1 

4666 

98 

0.91 

0.02 

0.00 

0.02 

BMF 

35 

5MD415 

A 

1 

42 

44 

1.14 

0.12 

0.87 

0.44 

BMF 

35 

5MD415 

B 

0 

9 

9 

0.28 

0.20 

0.73 

-0.20 

BMF 

35 

5MD415 

C 

0 

44 

46 

0.48 

0.10 

0.92 

-0.33 

BMF 

35 

5MD415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

36 

3NF29 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

BMF 

36 

3NF29 

A 

1 

98 

92 

1.88 

0.10 

0.98 

0.26 

BMF 

36 

3NF29 

B 

0 

5 

5 

0.92 

0.72 

1.44 

-0.19 

BMF 

36 

3NF29 

C 

0 

3 

3 

0.68 

0.45 

0.61 

-0.18 

BMF 

36 

3NF29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

37 

3G119 

* 

-1 

4769 

95 

1.17 

0.02 

0.00 

-0.11 

BMF 

37 

3G119 

A 

1 

202 

90 

2.00 

0.07 

0.92 

0.37 

BMF 

37 

3G119 

B 

0 

18 

8 

0.81 

0.19 

0.70 

-0.29 

BMF 

37 

3G119 

C 

0 

5 

2 

0.31 

0.45 

0.45 

-0.22 

BMF 

37 

3G119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

38 

3NBT13 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

BMF 

38 

3NBT13 

A 

1 

91 

78 

2.11 

0.12 

0.90 

0.47 

BMF 

38 

3NBT13 

B 

0 

9 

8 

0.90 

0.26 

0.72 

-0.23 

BMF 

38 

3NBT13 

C 

0 

17 

15 

0.73 

0.13 

0.55 

-0.39 

BMF 

38 

3NBT13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

39 

3MD26 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

BMF 

39 

3MD26 

A 

1 

80 

68 

2.21 

0.13 

0.91 

0.49 

BMF 

39 

3MD26 

B 

0 

16 

14 

0.77 

0.14 

0.52 

-0.36 

BMF 

39 

3MD26 

C 

0 

21 

18 

1.13 

0.17 

0.85 

-0.28 

BMF 

39 

3MD26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

40 

3NF317 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

BMF 

40 

3NF317 

A 

1 

56 

53 

2.23 

0.15 

0.88 

0.55 

BMF 

40 

3NF317 

B 

0 

16 

15 

0.82 

0.29 

0.86 

-0.28 

BMF 

40 

3NF317 

C 

0 

34 

32 

0.97 

0.12 

0.71 

-0.37 

BMF 

40 

3NF317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

1 

40A412 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

BMW 

1 

40A412 

A 

1 

74 

83 

1.60 

0.12 

0.97 

0.32 

BMW 

1 

40A412 

B 

0 

9 

10 

0.86 

0.18 

0.85 

-0.20 

BMW 

1 

40A412 

C 

0 

6 

7 

0.56 

0.17 

0.58 

-0.24 

BMW 

1 

40A412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

2 

40A124 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

BMW 

2 

40A124 

A 

1 

66 

62 

2.01 

0.14 

0.95 

0.40 

BMW 

2 

40A124 

B 

0 

16 

15 

1.03 

0.20 

0.89 

-0.24 

BMW 

2 

40A124 

C 

0 

24 

23 

1.14 

0.16 

0.94 

-0.26 

BMW 

2 

40A124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

3 

40A311 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

BMW 

3 

40A311 

A 

1 

36 

40 

1.41 

0.18 

1.24 

0.27 

BMW 

3 

40A311 

B 

0 

16 

18 

0.88 

0.22 

1.13 

-0.10 

BMW 

3 

40A311 

C 

0 

38 

42 

0.88 

0.12 

1.18 

-0.19 

BMW 

3 

40A311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

4 

4NBT311 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

BMW 

4 

4NBT311 

A 

1 

77 

73 

1.93 

0.13 

0.92 

0.39 

BMW 

4 

4NBT311 

B 

0 

26 

25 

1.04 

0.16 

1.00 

-0.33 

BMW 

4 

4NBT311 

C 

0 

3 

3 

0.35 

0.16 

0.36 

-0.20 

BMW 

4 

4NBT311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

5 

4NBT611 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.06 

BMW 

5 

4NBT611 

A 

1 

61 

69 

1.96 

0.11 

0.82 

0.55 

BMW 

5 

4NBT611 

B 

0 

10 

11 

0.79 

0.14 

0.57 

-0.30 

BMW 

5 

4NBT611 

C 

0 

18 

20 

0.85 

0.19 

0.80 

-0.40 

BMW 

5 

4NBT611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMW  = Benchmark  Winter. 


easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


148 

Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

6 

4NBT617 

* 

-1 

4778 

98 

1.00 

0.02 

0.00 

0.00 

BMW 

6 

4NBT617 

A 

1 

46 

43 

1.24 

0.11 

1.12 

0.26 

BMW 

6 

4NBT617 

B 

0 

26 

25 

0.92 

0.14 

1.08 

-0.07 

BMW 

6 

4NBT617 

C 

0 

34 

32 

0.80 

0.12 

1.00 

-0.21 

BMW 

6 

4NBT617 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

7 

4NF713 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

BMW 

7 

4NF713 

A 

1 

97 

88 

1.66 

0.08 

0.92 

0.40 

BMW 

7 

4NF713 

B 

0 

3 

3 

0.47 

0.71 

0.75 

-0.20 

BMW 

7 

4NF713 

C 

0 

10 

9 

0.59 

0.20 

0.63 

-0.33 

BMW 

7 

4NF713 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

8 

40506 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

BMW 

8 

40506 

A 

1 

40 

74 

1.19 

0.19 

1.73 

0.44 

BMW 

8 

40506 

B 

0 

12 

22 

0.07 

0.23 

0.80 

-0.35 

BMW 

8 

40506 

C 

0 

1 

2 

0.44 

0.00 

0.84 

-0.05 

BMW 

8 

40506 

D 

0 

1 

2 

-1.88 

0.00 

0.08 

-0.31 

BMW 

9 

40365 

* 

-1 

4812 

99 

1.00 

0.02 

0.00 

0.00 

BMW 

9 

40365 

A 

1 

52 

72 

1.50 

0.16 

0.74 

0.55 

BMW 

9 

40365 

B 

0 

2 

3 

-1.24 

0.44 

0.16 

-0.29 

BMW 

9 

40365 

C 

0 

7 

10 

-0.14 

0.13 

0.46 

-0.29 

BMW 

9 

40365 

D 

0 

11 

15 

0.07 

0.41 

1.39 

-0.31 

BMW 

10 

40803 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

BMW 

10 

40803 

A 

1 

36 

65 

1.40 

0.20 

0.91 

0.46 

BMW 

10 

40803 

B 

0 

5 

9 

0.68 

0.37 

1.30 

-0.07 

BMW 

10 

40803 

C 

0 

7 

13 

0.26 

0.27 

0.74 

-0.21 

BMW 

10 

40803 

D 

0 

7 

13 

-0.26 

0.49 

0.57 

-0.37 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

11 

40809 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

BMW 

11 

40809 

A 

1 

30 

59 

1.49 

0.20 

0.85 

0.49 

BMW 

11 

40809 

B 

0 

13 

25 

0.35 

0.24 

0.82 

-0.23 

BMW 

11 

40809 

C 

0 

2 

4 

-0.15 

0.62 

0.44 

-0.15 

BMW 

11 

40809 

D 

0 

6 

12 

-0.50 

0.99 

0.90 

-0.36 

BMW 

12 

4NF78 

* 

-1 

4780 

98 

1.00 

0.02 

0.00 

0.00 

BMW 

12 

4NF78 

A 

1 

59 

57 

1.24 

0.09 

1.02 

0.33 

BMW 

12 

4NF78 

B 

0 

26 

25 

0.62 

0.15 

0.91 

-0.31 

BMW 

12 

4NF78 

C 

0 

19 

18 

0.89 

0.16 

1.14 

-0.08 

BMW 

12 

4NF78 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

13 

40672 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.01 

BMW 

13 

40672 

A 

1 

30 

48 

1.35 

0.24 

0.97 

0.43 

BMW 

13 

40672 

B 

0 

27 

43 

0.36 

0.13 

0.85 

-0.36 

BMW 

13 

40672 

C 

0 

5 

8 

0.11 

0.29 

0.62 

-0.19 

BMW 

13 

40672 

D 

0 

1 

2 

1.88 

0.00 

3.12 

0.12 

BMW 

14 

40980 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

BMW 

14 

40980 

A 

1 

23 

40 

1.56 

0.25 

0.89 

0.42 

BMW 

14 

40980 

B 

0 

3 

5 

0.59 

0.27 

0.75 

-0.04 

BMW 

14 

40980 

C 

0 

16 

28 

0.85 

0.27 

2.13 

0.01 

BMW 

14 

40980 

D 

0 

15 

26 

-0.29 

0.43 

0.64 

-0.46 

BMW 

15 

40818 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

BMW 

15 

40818 

A 

1 

19 

37 

1.82 

0.35 

1.25 

0.47 

BMW 

15 

40818 

B 

0 

15 

29 

0.29 

0.28 

0.83 

-0.15 

BMW 

15 

40818 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

15 

40818 

D 

0 

18 

35 

-0.15 

0.48 

0.79 

-0.34 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

16 

4NF312 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

BMW 

16 

4NF312 

A 

1 

34 

35 

2.10 

0.18 

0.90 

0.51 

BMW 

16 

4NF312 

B 

0 

44 

46 

1.03 

0.12 

0.90 

-0.35 

BMW 

16 

4NF312 

C 

0 

18 

19 

1.03 

0.14 

0.72 

-0.18 

BMW 

16 

4NF312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

17 

4NF313 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

BMW 

17 

4NF313 

A 

1 

30 

33 

2.39 

0.17 

0.77 

0.59 

BMW 

17 

4NF313 

B 

0 

55 

60 

1.21 

0.08 

0.75 

-0.47 

BMW 

17 

4NF313 

C 

0 

7 

8 

0.99 

0.36 

0.71 

-0.18 

BMW 

17 

4NF313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

18 

40581 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

BMW 

18 

40581 

A 

1 

47 

87 

0.74 

0.13 

0.86 

0.48 

BMW 

18 

40581 

B 

0 

1 

2 

-1.22 

0.00 

0.24 

-0.24 

BMW 

18 

40581 

C 

0 

1 

2 

0.29 

0.00 

1.10 

-0.03 

BMW 

18 

40581 

D 

0 

5 

9 

-0.82 

0.53 

0.58 

-0.43 

BMW 

19 

4MD52 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

BMW 

19 

4MD52 

A 

1 

86 

93 

1.65 

0.10 

0.98 

0.26 

BMW 

19 

4MD52 

B 

0 

1 

1 

1.01 

0.00 

0.79 

-0.06 

BMW 

19 

4MD52 

C 

0 

5 

5 

0.56 

0.26 

0.57 

-0.26 

BMW 

19 

4MD52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

20 

40305 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

BMW 

20 

40305 

A 

1 

45 

83 

0.96 

0.18 

0.90 

0.41 

BMW 

20 

40305 

B 

0 

6 

11 

-0.12 

0.35 

0.87 

-0.25 

BMW 

20 

40305 

C 

0 

3 

6 

-0.92 

0.31 

0.32 

-0.33 

BMW 

20 

40305 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

21 

40297 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.01 

BMW 

21 

40297 

A 

1 

47 

78 

1.23 

0.20 

0.95 

0.51 

BMW 

21 

40297 

B 

0 

12 

20 

-0.49 

0.30 

0.64 

-0.45 

BMW 

21 

40297 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

21 

40297 

D 

0 

1 

2 

-1.78 

0.00 

0.12 

-0.23 

BMW 

22 

40714 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.04 

BMW 

22 

40714 

A 

1 

36 

72 

0.91 

0.19 

0.91 

0.49 

BMW 

22 

40714 

B 

0 

2 

4 

-0.70 

1.26 

0.76 

-0.19 

BMW 

22 

40714 

C 

0 

4 

8 

-1.21 

0.93 

0.72 

-0.38 

BMW 

22 

40714 

D 

0 

8 

16 

-0.18 

0.28 

0.87 

-0.22 

BMW 

23 

4MD54 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

BMW 

23 

4MD54 

A 

1 

67 

74 

1.27 

0.12 

0.97 

0.33 

BMW 

23 

4MD54 

B 

0 

18 

20 

0.57 

0.17 

0.94 

-0.27 

BMW 

23 

4MD54 

C 

0 

5 

6 

0.45 

0.35 

0.79 

-0.16 

BMW 

23 

4MD54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

24 

40759 

* 

-1 

4827 

99 

1.01 

0.02 

0.00 

0.06 

BMW 

24 

40759 

A 

1 

30 

53 

0.92 

0.23 

1.01 

0.50 

BMW 

24 

40759 

B 

0 

4 

7 

0.07 

0.55 

1.21 

-0.05 

BMW 

24 

40759 

C 

0 

9 

16 

-0.85 

0.35 

0.48 

-0.37 

BMW 

24 

40759 

D 

0 

14 

25 

-0.24 

0.28 

0.88 

-0.23 

BMW 

25 

4MD512 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

BMW 

25 

4MD512 

A 

1 

61 

67 

1.53 

0.14 

1.12 

0.15 

BMW 

25 

4MD512 

B 

0 

3 

3 

0.92 

0.53 

0.98 

-0.09 

BMW 

25 

4MD512 

C 

0 

27 

30 

1.25 

0.16 

1.46 

-0.12 

BMW 

25 

4MD512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

26 

40432 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

-0.01 

BMW 

26 

40432 

A 

1 

26 

54 

1.33 

0.25 

1.27 

0.23 

BMW 

26 

40432 

B 

0 

7 

15 

1.07 

0.31 

1.42 

-0.02 

BMW 

26 

40432 

C 

0 

3 

6 

0.51 

0.47 

0.79 

-0.15 

BMW 

26 

40432 

D 

0 

12 

25 

0.81 

0.17 

0.98 

-0.17 

BMW 

27 

4MD78 

* 

-1 

4768 

98 

0.98 

0.02 

0.00 

-0.08 

BMW 

27 

4MD78 

A 

1 

53 

46 

1.97 

0.19 

1.40 

0.24 

BMW 

27 

4MD78 

B 

0 

21 

18 

1.32 

0.30 

1.96 

-0.12 

BMW 

27 

4MD78 

C 

0 

42 

36 

1.37 

0.15 

1.21 

-0.16 

BMW 

27 

4MD78 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

28 

4G325 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

BMW 

28 

4G325 

A 

1 

76 

73 

1.52 

0.11 

0.98 

0.47 

BMW 

28 

4G325 

B 

0 

12 

12 

0.47 

0.27 

0.83 

-0.28 

BMW 

28 

4G325 

C 

0 

16 

15 

0.48 

0.16 

0.70 

-0.33 

BMW 

28 

4G325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

29 

4G119 

* 

-1 

4771 

98 

0.99 

0.02 

0.00 

-0.06 

BMW 

29 

4G119 

A 

1 

82 

73 

1.54 

0.11 

1.33 

0.01 

BMW 

29 

4G119 

B 

0 

6 

5 

1.48 

0.32 

1.51 

-0.02 

BMW 

29 

4G119 

C 

0 

25 

22 

1.52 

0.14 

1.57 

-0.01 

BMW 

29 

4G119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

30 

4G226 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

BMW 

30 

4G226 

A 

1 

55 

52 

2.07 

0.16 

1.01 

0.36 

BMW 

30 

4G226 

B 

0 

5 

5 

0.41 

0.30 

0.38 

-0.26 

BMW 

30 

4G226 

C 

0 

45 

43 

1.36 

0.12 

1.11 

-0.26 

BMW 

30 

4G226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

31 

50192 

* 

-1 

4703 

99 

0.90 

0.02 

0.00 

0.01 

BMW 

31 

50192 

A 

1 

48 

83 

0.99 

0.19 

0.96 

0.36 

BMW 

31 

50192 

B 

0 

2 

3 

-0.48 

0.82 

0.63 

-0.18 

BMW 

31 

50192 

C 

0 

5 

9 

0.35 

0.40 

1.33 

-0.10 

BMW 

31 

50192 

D 

0 

3 

5 

-1.18 

0.46 

0.29 

-0.35 

BMW 

32 

50109 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.04 

BMW 

32 

50109 

A 

1 

33 

63 

1.02 

0.21 

0.88 

0.55 

BMW 

32 

50109 

B 

0 

8 

15 

-0.50 

0.30 

0.69 

-0.29 

BMW 

32 

50109 

C 

0 

7 

13 

-0.51 

0.53 

1.25 

-0.27 

BMW 

32 

50109 

D 

0 

4 

8 

-0.73 

0.51 

0.58 

-0.25 

BMW 

33 

5NBT53 

* 

-1 

4648 

98 

0.88 

0.02 

0.00 

-0.11 

BMW 

33 

5NBT53 

A 

1 

97 

86 

2.04 

0.08 

0.88 

0.46 

BMW 

33 

5NBT53 

B 

0 

10 

9 

0.94 

0.21 

0.60 

-0.35 

BMW 

33 

5NBT53 

C 

0 

6 

5 

0.94 

0.17 

0.52 

-0.27 

BMW 

33 

5NBT53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

34 

50A229 

* 

-1 

4662 

98 

0.88 

0.02 

0.00 

-0.09 

BMW 

34 

50A229 

A 

1 

71 

72 

2.03 

0.10 

0.95 

0.50 

BMW 

34 

50A229 

B 

0 

13 

13 

1.00 

0.22 

0.75 

-0.30 

BMW 

34 

50A229 

C 

0 

15 

15 

0.96 

0.18 

0.70 

-0.34 

BMW 

34 

50A229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

35 

5NF79 

* 

-1 

4659 

98 

0.88 

0.02 

0.00 

-0.10 

BMW 

35 

5NF79 

A 

1 

66 

65 

2.13 

0.15 

1.02 

0.41 

BMW 

35 

5NF79 

B 

0 

18 

18 

1.47 

0.17 

1.10 

-0.13 

BMW 

35 

5NF79 

C 

0 

18 

18 

0.83 

0.17 

0.64 

-0.38 

BMW 

35 

5NF79 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

36 

3NF26 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

BMW 

36 

3NF26 

A 

1 

116 

94 

2.30 

0.10 

0.95 

0.33 

BMW 

36 

3NF26 

B 

0 

5 

4 

0.94 

0.41 

0.68 

-0.23 

BMW 

36 

3NF26 

C 

0 

2 

2 

0.15 

0.14 

0.21 

-0.24 

BMW 

36 

3NF26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

37 

3G17 

* 

-1 

4886 

98 

1.18 

0.02 

0.00 

-0.11 

BMW 

37 

3G17 

A 

1 

97 

90 

2.35 

0.15 

1.07 

0.26 

BMW 

37 

3G17 

B 

0 

9 

8 

1.12 

0.35 

1.15 

-0.22 

BMW 

37 

3G17 

C 

0 

2 

2 

0.84 

1.77 

1.71 

-0.13 

BMW 

37 

3G17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

38 

3NBT229 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

BMW 

38 

3NBT229 

A 

1 

93 

84 

2.53 

0.12 

0.92 

0.41 

BMW 

38 

3NBT229 

B 

0 

11 

10 

1.21 

0.25 

0.72 

-0.30 

BMW 

38 

3NBT229 

C 

0 

7 

6 

1.06 

0.42 

0.76 

-0.26 

BMW 

38 

3NBT229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

39 

3MD87 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

BMW 

39 

3MD87 

A 

1 

78 

73 

2.60 

0.17 

1.16 

0.41 

BMW 

39 

3MD87 

B 

0 

14 

13 

1.31 

0.29 

1.13 

-0.24 

BMW 

39 

3MD87 

C 

0 

15 

14 

1.10 

0.30 

0.87 

-0.30 

BMW 

39 

3MD87 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

40 

3NF265 

* 

-1 

4874 

98 

1.19 

0.02 

0.00 

-0.09 

BMW 

40 

3NF265 

A 

1 

71 

59 

2.41 

0.15 

0.97 

0.44 

BMW 

40 

3NF265 

B 

0 

32 

27 

1.49 

0.16 

1.15 

-0.24 

BMW 

40 

3NF265 

C 

0 

17 

14 

1.03 

0.14 

0.55 

-0.31 

BMW 

40 

3NF265 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

1 

40A37 

* 

-1 

4764 

98 

0.99 

0.02 

0.00 

-0.04 

BMS 

1 

40A37 

A 

1 

98 

82 

1.46 

0.09 

1.00 

0.38 

BMS 

1 

40  A3  7 

B 

0 

12 

10 

0.72 

0.18 

0.83 

-0.22 

BMS 

1 

40  A3  7 

C 

0 

10 

8 

0.48 

0.19 

0.63 

-0.29 

BMS 

1 

40A37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

2 

40A418 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

BMS 

2 

40A418 

A 

1 

65 

62 

1.94 

0.15 

1.14 

0.30 

BMS 

2 

40A418 

B 

0 

20 

19 

1.12 

0.16 

0.92 

-0.25 

BMS 

2 

40A418 

C 

0 

20 

19 

1.42 

0.16 

1.23 

-0.12 

BMS 

2 

40A418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

3 

40A54 

* 

-1 

4660 

95 

0.97 

0.02 

0.00 

-0.11 

BMS 

3 

40A54 

A 

1 

116 

52 

2.14 

0.11 

1.09 

0.42 

BMS 

3 

40A54 

B 

0 

49 

22 

1.29 

0.12 

1.10 

-0.17 

BMS 

3 

40A54 

C 

0 

59 

26 

1.02 

0.12 

0.83 

-0.32 

BMS 

3 

40A54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

4 

4NBT311 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

BMS 

4 

4NBT311 

A 

1 

77 

73 

1.93 

0.13 

0.92 

0.39 

BMS 

4 

4NBT311 

B 

0 

26 

25 

1.04 

0.16 

1.00 

-0.33 

BMS 

4 

4NBT311 

C 

0 

3 

3 

0.35 

0.16 

0.36 

-0.20 

BMS 

4 

4NBT311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

5 

4NBT611 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.06 

BMS 

5 

4NBT611 

A 

1 

61 

69 

1.96 

0.11 

0.82 

0.55 

BMS 

5 

4NBT611 

B 

0 

10 

11 

0.79 

0.14 

0.57 

-0.30 

BMS 

5 

4NBT611 

C 

0 

18 

20 

0.85 

0.19 

0.80 

-0.40 

BMS 

5 

4NBT611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

6 

4NBT55 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

BMS 

6 

4NBT55 

A 

1 

46 

52 

1.70 

0.16 

1.14 

0.26 

BMS 

6 

4NBT55 

B 

0 

21 

24 

1.19 

0.15 

1.06 

-0.15 

BMS 

6 

4NBT55 

C 

0 

22 

25 

1.19 

0.19 

1.42 

-0.15 

BMS 

6 

4NBT55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

7 

40660 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

BMS 

7 

40660 

A 

1 

43 

78 

1.18 

0.20 

0.98 

0.39 

BMS 

7 

40660 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

7 

40660 

C 

0 

6 

11 

0.16 

0.30 

0.87 

-0.20 

BMS 

7 

40660 

D 

0 

6 

11 

-0.31 

0.45 

0.82 

-0.32 

BMS 

8 

40966 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.00 

BMS 

8 

40966 

A 

1 

36 

72 

1.34 

0.26 

1.09 

0.39 

BMS 

8 

40966 

B 

0 

3 

6 

0.62 

0.28 

1.27 

-0.05 

BMS 

8 

40966 

C 

0 

6 

12 

-0.03 

0.61 

1.54 

-0.23 

BMS 

8 

40966 

D 

0 

5 

10 

-0.49 

0.74 

1.01 

-0.30 

BMS 

9 

40365 

* 

-1 

4812 

99 

1.00 

0.02 

0.00 

0.00 

BMS 

9 

40365 

A 

1 

52 

72 

1.50 

0.16 

0.74 

0.55 

BMS 

9 

40365 

B 

0 

2 

3 

-1.24 

0.44 

0.16 

-0.29 

BMS 

9 

40365 

C 

0 

7 

10 

-0.14 

0.13 

0.46 

-0.29 

BMS 

9 

40365 

D 

0 

11 

15 

0.07 

0.41 

1.39 

-0.31 

BMS 

10 

40803 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

BMS 

10 

40803 

A 

1 

36 

65 

1.40 

0.20 

0.91 

0.46 

BMS 

10 

40803 

B 

0 

5 

9 

0.68 

0.37 

1.30 

-0.07 

BMS 

10 

40803 

C 

0 

7 

13 

0.26 

0.27 

0.74 

-0.21 

BMS 

10 

40803 

D 

0 

7 

13 

-0.26 

0.49 

0.57 

-0.37 

Note.  BMS  = Benchmark  Spring. 


easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


157 

Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

11 

4NF26 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

BMS 

11 

4NF26 

A 

1 

78 

71 

1.74 

0.10 

1.02 

0.36 

BMS 

11 

4NF26 

B 

0 

9 

8 

0.71 

0.21 

0.58 

-0.28 

BMS 

11 

4NF26 

C 

0 

23 

21 

1.16 

0.15 

1.01 

-0.22 

BMS 

11 

4NF26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

12 

40810 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.03 

BMS 

12 

40810 

A 

1 

30 

48 

1.26 

0.26 

1.27 

0.43 

BMS 

12 

40810 

B 

0 

9 

15 

0.28 

0.36 

1.15 

-0.13 

BMS 

12 

40810 

C 

0 

4 

6 

0.02 

0.39 

0.68 

-0.13 

BMS 

12 

40810 

D 

0 

19 

31 

0.09 

0.21 

0.85 

-0.30 

BMS 

13 

40066 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.04 

BMS 

13 

40066 

A 

1 

27 

45 

1.51 

0.26 

1.10 

0.51 

BMS 

13 

40066 

B 

0 

12 

20 

0.15 

0.32 

0.95 

-0.09 

BMS 

13 

40066 

C 

0 

8 

13 

-0.04 

0.39 

0.77 

-0.11 

BMS 

13 

40066 

D 

0 

13 

22 

-1.00 

0.67 

0.65 

-0.43 

BMS 

14 

40062 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.00 

BMS 

14 

40062 

A 

1 

27 

43 

2.07 

0.31 

0.93 

0.55 

BMS 

14 

40062 

B 

0 

7 

11 

0.45 

0.51 

0.99 

-0.10 

BMS 

14 

40062 

C 

0 

12 

19 

0.25 

0.22 

0.59 

-0.20 

BMS 

14 

40062 

D 

0 

17 

27 

-0.06 

0.43 

0.80 

-0.36 

BMS 

15 

4NF75 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

BMS 

15 

4NF75 

A 

1 

44 

48 

1.93 

0.14 

0.96 

0.45 

BMS 

15 

4NF75 

B 

0 

44 

48 

1.14 

0.11 

0.98 

-0.37 

BMS 

15 

4NF75 

C 

0 

3 

3 

0.42 

0.07 

0.35 

-0.21 

BMS 

15 

4NF75 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

16 

4NF312 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

BMS 

16 

4NF312 

A 

1 

34 

35 

2.10 

0.18 

0.90 

0.51 

BMS 

16 

4NF312 

B 

0 

44 

46 

1.03 

0.12 

0.90 

-0.35 

BMS 

16 

4NF312 

C 

0 

18 

19 

1.03 

0.14 

0.72 

-0.18 

BMS 

16 

4NF312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

17 

4NF414 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.06 

BMS 

17 

4NF414 

A 

1 

30 

33 

2.05 

0.17 

1.06 

0.34 

BMS 

17 

4NF414 

B 

0 

16 

18 

1.75 

0.21 

1.69 

0.07 

BMS 

17 

4NF414 

C 

0 

44 

49 

1.23 

0.13 

1.00 

-0.37 

BMS 

17 

4NF414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

18 

40873 

* 

-1 

4840 

99 

1.00 

0.02 

0.00 

0.00 

BMS 

18 

40873 

A 

1 

40 

91 

1.06 

0.17 

1.07 

0.15 

BMS 

18 

40873 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

18 

40873 

C 

0 

4 

9 

0.48 

0.48 

1.23 

-0.15 

BMS 

18 

40873 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

19 

40306 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.00 

BMS 

19 

40306 

A 

1 

56 

86 

1.16 

0.18 

0.93 

0.35 

BMS 

19 

40306 

B 

0 

6 

9 

-0.19 

0.59 

1.49 

-0.26 

BMS 

19 

40306 

C 

0 

2 

3 

-0.66 

0.56 

0.42 

-0.20 

BMS 

19 

40306 

D 

0 

1 

2 

-0.08 

0.00 

0.64 

-0.09 

BMS 

20 

40713 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.03 

BMS 

20 

40713 

A 

1 

41 

82 

0.83 

0.19 

0.95 

0.32 

BMS 

20 

40713 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

20 

40713 

C 

0 

5 

10 

-0.45 

0.74 

1.24 

-0.28 

BMS 

20 

40713 

D 

0 

4 

8 

0.05 

0.44 

1.03 

-0.14 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

21 

40592 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.00 

BMS 

21 

40592 

A 

1 

40 

82 

1.38 

0.18 

0.84 

0.53 

BMS 

21 

40592 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

21 

40592 

C 

0 

4 

8 

0.85 

0.24 

1.25 

-0.03 

BMS 

21 

40592 

D 

0 

5 

10 

-1.92 

0.83 

0.18 

-0.65 

BMS 

22 

40880 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

BMS 

22 

40880 

A 

1 

42 

76 

0.95 

0.17 

0.97 

0.35 

BMS 

22 

40880 

B 

0 

3 

5 

-0.21 

0.85 

1.07 

-0.20 

BMS 

22 

40880 

C 

0 

5 

9 

0.29 

0.23 

0.94 

-0.12 

BMS 

22 

40880 

D 

0 

5 

9 

-0.14 

0.62 

0.98 

-0.24 

BMS 

23 

40792 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

BMS 

23 

40792 

A 

1 

34 

63 

1.02 

0.20 

0.87 

0.48 

BMS 

23 

40792 

B 

0 

6 

11 

-0.33 

0.24 

0.54 

-0.20 

BMS 

23 

40792 

C 

0 

9 

17 

0.07 

0.35 

1.27 

-0.13 

BMS 

23 

40792 

D 

0 

5 

9 

-1.36 

1.06 

0.68 

-0.41 

BMS 

24 

40910 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

BMS 

24 

40910 

A 

1 

34 

61 

1.01 

0.19 

1.80 

0.36 

BMS 

24 

40910 

B 

0 

8 

14 

0.21 

0.33 

0.99 

-0.17 

BMS 

24 

40910 

C 

0 

4 

7 

0.17 

0.37 

0.80 

-0.12 

BMS 

24 

40910 

D 

0 

10 

18 

0.12 

0.37 

1.02 

-0.23 

BMS 

25 

41033 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

BMS 

25 

41033 

A 

1 

30 

56 

1.34 

0.23 

1.04 

0.44 

BMS 

25 

41033 

B 

0 

12 

22 

0.60 

0.30 

1.37 

-0.11 

BMS 

25 

41033 

C 

0 

4 

7 

-0.54 

0.40 

0.35 

-0.32 

BMS 

25 

41033 

D 

0 

8 

15 

0.13 

0.24 

0.67 

-0.25 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

26 

40163 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

BMS 

26 

40163 

A 

1 

28 

51 

1.81 

0.25 

1.20 

0.64 

BMS 

26 

40163 

B 

0 

10 

18 

-0.12 

0.14 

0.40 

-0.38 

BMS 

26 

40163 

C 

0 

13 

24 

0.25 

0.19 

0.66 

-0.30 

BMS 

26 

40163 

D 

0 

4 

7 

0.05 

0.54 

0.71 

-0.19 

BMS 

27 

4MD72 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

BMS 

27 

4MD72 

A 

1 

37 

42 

1.68 

0.20 

1.33 

0.20 

BMS 

27 

4MD72 

B 

0 

35 

39 

1.36 

0.12 

1.24 

-0.08 

BMS 

27 

4MD72 

C 

0 

17 

19 

1.14 

0.20 

1.03 

-0.15 

BMS 

27 

4MD72 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

28 

4G133 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

BMS 

28 

4G133 

A 

1 

73 

78 

1.63 

0.11 

0.99 

0.26 

BMS 

28 

4G133 

B 

0 

10 

11 

1.28 

0.27 

1.38 

-0.08 

BMS 

28 

4G133 

C 

0 

11 

12 

0.83 

0.25 

0.91 

-0.26 

BMS 

28 

4G133 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

29 

4G232 

* 

-1 

4675 

96 

0.99 

0.02 

0.00 

-0.04 

BMS 

29 

4G232 

A 

1 

141 

67 

1.52 

0.07 

0.90 

0.44 

BMS 

29 

4G232 

B 

0 

52 

25 

0.81 

0.10 

0.95 

-0.30 

BMS 

29 

4G232 

C 

0 

16 

8 

0.42 

0.20 

0.66 

-0.28 

BMS 

29 

4G232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

30 

4G233 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

BMS 

30 

4G233 

A 

1 

46 

49 

1.96 

0.14 

0.94 

0.49 

BMS 

30 

4G233 

B 

0 

21 

22 

0.89 

0.14 

0.69 

-0.35 

BMS 

30 

4G233 

C 

0 

27 

29 

1.19 

0.13 

0.94 

-0.21 

BMS 

30 

4G233 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMS  = Benchmark  Spring. 


easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


161 

Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

31 

50661 

* 

-1 

4709 

99 

0.91 

0.02 

0.00 

0.05 

BMS 

31 

50661 

A 

1 

41 

79 

0.47 

0.14 

0.95 

0.36 

BMS 

31 

50661 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

31 

50661 

C 

0 

4 

8 

-0.10 

0.46 

1.16 

-0.12 

BMS 

31 

50661 

D 

0 

7 

13 

-0.53 

0.34 

0.89 

-0.34 

BMS 

32 

5G122 

* 

-1 

4650 

98 

0.89 

0.02 

0.00 

-0.06 

BMS 

32 

5G122 

A 

1 

91 

82 

1.59 

0.10 

0.93 

0.36 

BMS 

32 

5G122 

B 

0 

18 

16 

0.75 

0.18 

0.82 

-0.32 

BMS 

32 

5G122 

C 

0 

2 

2 

0.39 

0.14 

0.46 

-0.15 

BMS 

32 

5G122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

33 

5G34 

* 

-1 

4636 

97 

0.89 

0.02 

0.00 

-0.04 

BMS 

33 

5G34 

A 

1 

95 

76 

1.39 

0.10 

1.01 

0.28 

BMS 

33 

5G34 

B 

0 

23 

18 

0.73 

0.19 

1.19 

-0.23 

BMS 

33 

5G34 

C 

0 

7 

6 

0.69 

0.27 

0.97 

-0.13 

BMS 

33 

5G34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

34 

51029 

* 

-1 

4705 

99 

0.91 

0.02 

0.00 

0.02 

BMS 

34 

51029 

A 

1 

28 

50 

1.13 

0.19 

0.94 

0.48 

BMS 

34 

51029 

B 

0 

20 

36 

0.16 

0.22 

0.94 

-0.34 

BMS 

34 

51029 

C 

0 

6 

11 

-0.06 

0.22 

0.58 

-0.23 

BMS 

34 

51029 

D 

0 

2 

4 

0.42 

0.33 

0.86 

-0.04 

BMS 

35 

50A322 

* 

-1 

4661 

98 

0.89 

0.02 

0.00 

-0.06 

BMS 

35 

50A322 

A 

1 

59 

59 

1.84 

0.11 

0.86 

0.51 

BMS 

35 

50A322 

B 

0 

15 

15 

0.81 

0.12 

0.63 

-0.31 

BMS 

35 

50A322 

C 

0 

26 

26 

0.99 

0.13 

0.83 

-0.32 

BMS 

35 

50A322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

36 

3NF28 

* 

-1 

4883 

98 

1.19 

0.02 

0.00 

-0.10 

BMS 

36 

3NF28 

A 

1 

103 

93 

2.21 

0.13 

0.96 

0.31 

BMS 

36 

3NF28 

B 

0 

7 

6 

0.82 

0.30 

0.67 

-0.25 

BMS 

36 

3NF28 

C 

0 

1 

1 

-0.65 

0.00 

0.12 

-0.20 

BMS 

36 

3NF28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

37 

3G211 

* 

-1 

4886 

98 

1.18 

0.02 

0.00 

-0.11 

BMS 

37 

3G211 

A 

1 

97 

90 

2.42 

0.14 

0.93 

0.40 

BMS 

37 

3G211 

B 

0 

7 

6 

0.51 

0.45 

0.93 

-0.30 

BMS 

37 

3G211 

C 

0 

4 

4 

0.28 

0.47 

0.45 

-0.25 

BMS 

37 

3G211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

38 

3NBT321 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

BMS 

38 

3NBT321 

A 

1 

83 

78 

2.04 

0.11 

1.13 

0.44 

BMS 

38 

3NBT321 

B 

0 

20 

19 

0.89 

0.15 

0.64 

-0.42 

BMS 

38 

3NBT321 

C 

0 

3 

3 

1.13 

0.10 

0.67 

-0.11 

BMS 

38 

3NBT321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

39 

3MD25 

* 

-1 

4867 

97 

1.19 

0.02 

0.00 

-0.08 

BMS 

39 

3MD25 

A 

1 

88 

69 

2.40 

0.12 

0.82 

0.60 

BMS 

39 

3MD25 

B 

0 

23 

18 

0.80 

0.17 

0.58 

-0.42 

BMS 

39 

3MD25 

C 

0 

16 

13 

0.77 

0.20 

0.58 

-0.35 

BMS 

39 

3MD25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

40 

3NF280 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

BMS 

40 

3NF280 

A 

1 

70 

60 

2.33 

0.13 

0.97 

0.44 

BMS 

40 

3NF280 

B 

0 

22 

19 

1.35 

0.13 

0.78 

-0.27 

BMS 

40 

3NF280 

C 

0 

24 

21 

1.36 

0.18 

0.91 

-0.28 

BMS 

40 

3NF280 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMS  = Benchmark  Spring. 
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Appendix  D:  Item  Statistics 


Appendix  D:  Item  Statistics  for  Full  CCSS  Item  Bank 
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Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40001 

-3.89 

57 

55 

0.87 

0.46 

-0.75 

0.07 

-0.79 

0.00 

0.55 

1.24 

40002 

-3.84 

43 

42 

1.06 

0.63 

-0.20 

0.08 

-0.74 

-0.01 

0.39 

1.20 

40003 

0.66 

56 

28 

0.30 

1.16 

1.54 

1.24 

1.30 

0.00 

0.34 

0.40 

40004 

-2.66 

57 

53 

0.56 

0.93 

-0.01 

1.41 

0.72 

0.00 

0.23 

0.97 

40005 

-4.00 

55 

53 

1.03 

1.00 

0.31 

0.33 

-0.19 

0.00 

0.49 

1.04 

40006 

2.59 

50 

9 

0.40 

0.94 

-0.18 

1.00 

0.17 

0.00 

0.40 

1.04 

40007 

-3.17 

60 

58 

0.74 

1.12 

0.40 

1.12 

0.48 

-0.01 

0.08 

0.91 

40008 

0.13 

63 

36 

0.29 

1.21 

1.70 

1.31 

1.44 

0.00 

0.33 

0.47 

40009 

-0.39 

56 

37 

0.32 

0.71 

-2.24 

0.60 

-1.93 

0.00 

0.60 

1.63 

40010 

-0.23 

55 

39 

0.33 

1.07 

0.49 

1.15 

0.64 

0.00 

0.36 

0.87 

40011 

-2.02 

55 

49 

0.45 

0.93 

-0.13 

0.58 

-0.62 

0.00 

0.33 

1.10 

40012 

-0.49 

65 

49 

0.32 

1.04 

0.32 

1.05 

0.28 

0.00 

0.36 

0.93 

40013 

-1.75 

51 

45 

0.49 

1.03 

0.19 

0.62 

-0.41 

0.00 

0.39 

1.04 

40014 

-1.58 

56 

48 

0.40 

0.92 

-0.25 

0.98 

0.11 

0.00 

0.31 

1.06 

40015 

-0.17 

47 

35 

0.37 

1.06 

0.35 

0.95 

-0.06 

0.00 

0.39 

0.95 

40016 

-0.78 

55 

44 

0.38 

0.89 

-0.44 

0.78 

-0.51 

0.00 

0.48 

1.13 

40017 

-1.13 

3062 

2507 

0.05 

0.91 

-3.22 

0.78 

-3.79 

0.00 

0.45 

1.12 

40018 

-2.27 

65 

60 

0.49 

1.10 

0.40 

2.09 

1.39 

-0.01 

0.14 

0.86 

40019 

-1.36 

50 

43 

0.43 

0.90 

-0.28 

0.78 

-0.37 

0.00 

0.40 

1.10 

40020 

-0.78 

57 

42 

0.34 

0.85 

-0.86 

0.78 

-0.55 

-0.01 

0.53 

1.22 

40021 

-1.66 

55 

49 

0.45 

0.86 

-0.38 

0.60 

-0.65 

0.00 

0.36 

1.14 

40022 

-0.84 

58 

45 

0.35 

1.19 

1.03 

1.17 

0.51 

0.00 

0.28 

0.75 

40023 

-1.29 

264 

240 

0.22 

0.85 

-0.92 

0.54 

-1.78 

0.00 

0.42 

1.14 

40024 

-1.51 

53 

45 

0.42 

0.94 

-0.16 

1.26 

0.63 

-0.01 

0.34 

1.02 

40025 

-0.71 

66 

54 

0.34 

0.80 

-0.96 

0.69 

-0.97 

0.00 

0.49 

1.22 

40026 

-0.59 

56 

41 

0.34 

1.01 

0.13 

0.94 

-0.12 

0.00 

0.42 

1.00 

40027 

-1.08 

63 

52 

0.36 

0.83 

-0.79 

0.67 

-0.70 

0.00 

0.52 

1.19 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40028 

1.17 

49 

22 

0.31 

0.81 

-1.99 

0.76 

-1.74 

0.00 

0.54 

1.77 

40029 

0.36 

52 

33 

0.33 

1.14 

1.04 

1.61 

2.00 

0.00 

0.34 

0.57 

40030 

-0.80 

59 

46 

0.35 

0.92 

-0.36 

1.00 

0.14 

-0.01 

0.46 

1.06 

40031 

-0.79 

56 

41 

0.35 

0.87 

-0.68 

0.66 

-1.24 

0.00 

0.56 

1.24 

40032 

-0.94 

56 

43 

0.35 

0.82 

-1.02 

0.62 

-0.84 

0.00 

0.50 

1.31 

40033 

-1.59 

265 

243 

0.23 

1.01 

0.09 

0.67 

-1.18 

0.00 

0.29 

1.04 

40034 

1.06 

70 

33 

0.27 

0.89 

-1.11 

0.89 

-0.67 

0.00 

0.52 

1.30 

40035 

0.60 

67 

38 

0.28 

1.18 

1.47 

1.23 

1.15 

0.00 

0.35 

0.59 

40036 

-0.59 

68 

49 

0.30 

0.90 

-0.63 

0.78 

-0.66 

0.00 

0.49 

1.18 

40037 

-2.49 

69 

65 

0.54 

0.86 

-0.21 

0.59 

-0.26 

-0.01 

0.33 

1.08 

40038 

-3.75 

54 

52 

0.86 

0.79 

-0.06 

0.56 

0.10 

0.00 

0.41 

1.06 

40039 

-1.31 

55 

46 

0.39 

0.96 

-0.11 

0.80 

-0.17 

0.00 

0.37 

1.05 

40040 

-0.23 

59 

41 

0.31 

0.95 

-0.32 

0.78 

-0.69 

0.00 

0.47 

1.15 

40041 

-1.43 

262 

240 

0.23 

0.90 

-0.53 

0.68 

-1.12 

0.00 

0.35 

1.08 

40042 

0.33 

56 

36 

0.31 

0.90 

-0.81 

0.78 

-1.09 

0.00 

0.49 

1.30 

40043 

1.49 

55 

18 

0.34 

1.00 

0.03 

1.18 

0.73 

0.00 

0.49 

0.96 

40044 

0.23 

54 

32 

0.33 

0.68 

-2.49 

0.58 

-2.23 

0.00 

0.68 

1.69 

40045 

-0.38 

285 

228 

0.16 

0.91 

-0.96 

0.81 

-1.14 

0.00 

0.43 

1.12 

40046 

-0.25 

47 

33 

0.36 

1.09 

0.57 

1.26 

0.87 

0.00 

0.35 

0.78 

40047 

0.89 

55 

24 

0.30 

0.84 

-1.47 

0.77 

-1.37 

0.00 

0.57 

1.48 

40048 

1.55 

61 

24 

0.29 

1.13 

1.20 

1.30 

1.02 

0.00 

0.32 

0.52 

40049 

1.03 

52 

23 

0.32 

1.02 

0.20 

1.08 

0.40 

0.00 

0.45 

0.91 

40050 

0.06 

57 

38 

0.32 

1.02 

0.21 

0.95 

-0.13 

0.00 

0.45 

0.98 

40051 

0.76 

49 

26 

0.33 

0.80 

-1.75 

0.75 

-1.61 

0.00 

0.57 

1.61 

40052 

0.72 

55 

29 

0.30 

0.94 

-0.50 

0.89 

-0.52 

0.00 

0.47 

1.20 

40053 

0.14 

60 

37 

0.29 

1.05 

0.47 

1.02 

0.17 

0.00 

0.33 

0.88 

40054 

0.07 

51 

31 

0.33 

1.03 

0.28 

0.93 

-0.07 

0.00 

0.45 

0.97 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40055 

0.66 

55 

30 

0.31 

1.04 

0.39 

1.29 

1.13 

0.00 

0.43 

0.81 

40056 

0.46 

49 

27 

0.32 

1.09 

0.74 

1.04 

0.25 

0.00 

0.35 

0.78 

40057 

0.35 

56 

33 

0.32 

1.38 

2.59 

2.86 

5.15 

0.00 

0.20 

-0.21 

40058 

0.31 

53 

31 

0.31 

1.15 

1.31 

1.35 

1.51 

0.00 

0.24 

0.44 

40059 

0.04 

47 

30 

0.34 

0.94 

-0.33 

0.86 

-0.28 

0.00 

0.49 

1.13 

40060 

0.00 

56 

34 

0.32 

1.17 

1.19 

1.54 

1.68 

0.00 

0.35 

0.53 

40061 

0.76 

64 

30 

0.28 

0.99 

-0.03 

1.09 

0.49 

0.00 

0.42 

0.95 

40062 

1.35 

63 

27 

0.30 

0.88 

-1.01 

0.87 

-0.53 

0.00 

0.55 

1.28 

40063 

3.74 

56 

7 

0.50 

0.84 

-0.39 

0.84 

-0.01 

0.00 

0.60 

1.08 

40064 

2.48 

56 

11 

0.39 

0.74 

-1.09 

0.48 

-1.43 

0.00 

0.68 

1.28 

40065 

2.46 

53 

11 

0.39 

1.24 

1.06 

2.02 

2.06 

0.00 

0.29 

0.63 

40066 

0.90 

60 

27 

0.31 

0.92 

-0.55 

0.96 

-0.12 

0.00 

0.51 

1.13 

40067 

1.87 

57 

19 

0.32 

0.88 

-0.87 

0.82 

-0.60 

0.00 

0.54 

1.25 

40068 

2.42 

3037 

657 

0.05 

0.93 

-2.66 

1.12 

2.10 

0.00 

0.46 

1.06 

40069 

4.01 

51 

6 

0.58 

0.55 

-1.21 

0.18 

-1.26 

0.00 

0.78 

1.30 

40070 

1.02 

280 

147 

0.13 

0.93 

-1.53 

0.91 

-1.28 

0.00 

0.46 

1.23 

40071 

2.08 

59 

16 

0.34 

1.06 

0.44 

1.36 

1.07 

0.00 

0.39 

0.81 

40072 

1.57 

56 

20 

0.31 

1.04 

0.35 

1.18 

0.77 

0.00 

0.36 

0.83 

40073 

2.20 

55 

12 

0.37 

0.81 

-0.90 

0.68 

-0.84 

0.00 

0.60 

1.22 

40074 

-0.49 

57 

43 

0.35 

1.23 

1.21 

1.45 

1.14 

0.00 

0.24 

0.64 

40075 

-0.57 

56 

41 

0.34 

1.08 

0.53 

1.12 

0.49 

0.00 

0.38 

0.88 

40076 

0.15 

59 

38 

0.31 

1.07 

0.53 

1.41 

1.35 

0.00 

0.39 

0.79 

40077 

0.59 

52 

28 

0.32 

1.16 

1.27 

1.21 

1.12 

0.00 

0.36 

0.53 

40078 

-1.59 

55 

49 

0.45 

0.97 

0.00 

0.92 

0.13 

-0.01 

0.26 

1.01 

40079 

-0.60 

267 

218 

0.17 

0.98 

-0.18 

0.89 

-0.62 

0.00 

0.37 

1.05 

40080 

-1.58 

54 

47 

0.43 

1.10 

0.44 

1.28 

0.64 

0.00 

0.19 

0.88 

40081 

0.60 

56 

28 

0.29 

1.14 

1.32 

1.16 

1.14 

0.00 

0.28 

0.52 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40082 

-0.10 

55 

33 

0.31 

1.04 

0.38 

1.11 

0.62 

0.00 

0.39 

0.86 

40083 

0.98 

56 

27 

0.30 

1.07 

0.67 

1.15 

0.64 

0.00 

0.41 

0.74 

40084 

0.44 

60 

31 

0.30 

0.78 

-2.10 

0.66 

-1.53 

0.00 

0.62 

1.61 

40085 

1.97 

55 

18 

0.33 

0.84 

-1.12 

0.87 

-0.39 

0.00 

0.58 

1.27 

40086 

-0.06 

50 

32 

0.34 

1.04 

0.30 

0.90 

-0.29 

0.00 

0.48 

0.98 

40087 

-0.35 

55 

37 

0.32 

0.82 

-1.35 

0.72 

-1.19 

0.00 

0.55 

1.39 

40088 

1.03 

65 

35 

0.27 

1.01 

0.09 

1.03 

0.25 

0.00 

0.40 

0.96 

40089 

-0.23 

65 

45 

0.30 

1.04 

0.29 

0.97 

-0.03 

0.00 

0.43 

0.95 

40090 

2.32 

52 

14 

0.35 

0.72 

-1.78 

0.58 

-1.34 

0.00 

0.62 

1.46 

40091 

-2.46 

56 

52 

0.58 

0.87 

-0.20 

1.30 

0.60 

-0.01 

0.35 

1.03 

40092 

-1.41 

60 

50 

0.39 

0.94 

-0.19 

0.73 

-0.37 

0.00 

0.49 

1.08 

40093 

-0.93 

53 

42 

0.37 

1.00 

0.07 

1.15 

0.53 

0.00 

0.33 

0.98 

40094 

0.23 

64 

38 

0.29 

0.96 

-0.30 

0.89 

-0.44 

0.00 

0.48 

1.12 

40095 

-0.62 

55 

43 

0.37 

0.71 

-1.55 

0.49 

-1.36 

0.00 

0.59 

1.40 

40096 

-1.28 

59 

49 

0.39 

0.85 

-0.64 

0.58 

-0.84 

-0.01 

0.47 

1.20 

40097 

-0.85 

53 

44 

0.40 

0.99 

0.02 

1.85 

1.54 

0.00 

0.29 

0.88 

40098 

-1.55 

64 

56 

0.44 

0.93 

-0.12 

0.82 

-0.10 

0.00 

0.53 

1.07 

40099 

-0.77 

56 

43 

0.35 

1.01 

0.13 

0.91 

-0.20 

0.00 

0.37 

1.01 

40100 

-1.47 

52 

44 

0.43 

0.94 

-0.15 

0.76 

-0.25 

0.00 

0.41 

1.07 

40101 

3.25 

54 

7 

0.46 

0.89 

-0.25 

1.22 

0.54 

0.00 

0.43 

1.03 

40102 

4.67 

55 

2 

0.74 

1.16 

0.45 

2.78 

1.44 

0.00 

-0.01 

0.82 

40103 

3.07 

48 

9 

0.44 

1.27 

1.01 

1.64 

1.22 

0.00 

0.36 

0.70 

40104 

5.13 

54 

1 

1.03 

1.08 

0.40 

1.40 

0.72 

0.00 

0.02 

0.93 

40105 

3.66 

56 

5 

0.51 

0.92 

-0.09 

1.88 

1.13 

0.00 

0.29 

0.95 

40106 

-1.22 

52 

42 

0.41 

0.81 

-0.74 

0.50 

-0.87 

0.00 

0.60 

1.24 

40107 

3.06 

70 

11 

0.37 

1.13 

0.60 

2.45 

2.50 

0.00 

0.25 

0.76 

40108 

1.23 

58 

24 

0.30 

1.17 

1.44 

1.25 

1.39 

0.00 

0.29 

0.51 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40109 

1.80 

56 

16 

0.33 

1.00 

0.08 

1.20 

0.82 

0.00 

0.38 

0.95 

40110 

-0.31 

56 

39 

0.33 

1.11 

0.71 

1.24 

0.88 

0.00 

0.36 

0.79 

40111 

-0.61 

55 

35 

0.32 

1.12 

0.90 

3.06 

3.60 

0.00 

0.32 

0.50 

40112 

0.54 

65 

37 

0.28 

1.07 

0.68 

1.22 

1.16 

0.00 

0.36 

0.71 

40113 

0.47 

58 

32 

0.29 

1.06 

0.61 

1.01 

0.13 

0.00 

0.34 

0.85 

40114 

0.31 

74 

44 

0.26 

0.89 

-1.13 

0.79 

-1.36 

-0.01 

0.51 

1.37 

40115 

-1.42 

57 

49 

0.40 

1.08 

0.40 

0.80 

-0.27 

0.00 

0.27 

0.97 

40116 

0.71 

55 

28 

0.30 

1.01 

0.15 

0.92 

-0.36 

0.00 

0.45 

1.02 

40117 

-0.13 

55 

38 

0.33 

1.04 

0.34 

0.97 

-0.03 

0.00 

0.41 

0.94 

40118 

0.90 

50 

24 

0.33 

0.92 

-0.57 

0.89 

-0.30 

0.00 

0.54 

1.17 

40119 

0.74 

55 

24 

0.30 

1.69 

4.91 

2.04 

4.13 

0.00 

-0.16 

-1.00 

40120 

2.14 

3033 

775 

0.05 

1.22 

8.24 

1.82 

9.90 

0.00 

0.26 

0.61 

40121 

3.41 

59 

6 

0.47 

0.98 

0.05 

2.57 

2.04 

0.00 

0.24 

0.90 

40122 

1.01 

56 

24 

0.31 

0.98 

-0.15 

1.05 

0.28 

0.00 

0.49 

1.03 

40123 

3.29 

62 

7 

0.44 

1.10 

0.40 

1.05 

0.27 

0.00 

0.30 

0.93 

40124 

3.19 

56 

8 

0.42 

1.41 

1.41 

2.73 

2.11 

0.00 

0.00 

0.48 

40125 

0.86 

56 

27 

0.30 

0.63 

-3.70 

0.56 

-2.74 

0.00 

0.66 

2.05 

40126 

3.08 

55 

7 

0.46 

1.24 

0.80 

1.85 

1.36 

0.00 

0.20 

0.76 

40127 

-1.46 

58 

48 

0.38 

1.06 

0.34 

1.05 

0.27 

0.00 

0.30 

0.93 

40128 

-2.65 

52 

48 

0.63 

1.09 

0.34 

0.47 

-0.45 

0.00 

0.48 

1.03 

40129 

-0.43 

56 

39 

0.34 

0.83 

-1.06 

0.71 

-1.06 

0.00 

0.59 

1.29 

40130 

-1.29 

57 

47 

0.38 

0.99 

0.04 

0.80 

-0.27 

0.00 

0.38 

1.03 

40131 

-1.06 

48 

37 

0.38 

1.05 

0.33 

0.83 

-0.04 

0.00 

0.38 

0.97 

40132 

-1.58 

56 

48 

0.43 

0.91 

-0.23 

0.57 

-0.56 

0.00 

0.50 

1.12 

40133 

-1.05 

55 

44 

0.36 

0.90 

-0.48 

1.87 

1.98 

0.00 

0.35 

1.04 

40134 

-0.92 

55 

40 

0.35 

0.87 

-0.70 

0.75 

-0.71 

0.00 

0.53 

1.20 

40135 

-1.95 

50 

45 

0.51 

1.10 

0.41 

1.05 

0.34 

0.00 

0.26 

0.93 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40136 

-1.35 

61 

50 

0.39 

1.21 

0.89 

1.28 

0.69 

0.00 

0.32 

0.79 

40137 

-0.69 

57 

43 

0.34 

0.81 

-1.15 

0.65 

-0.95 

0.00 

0.55 

1.31 

40138 

-0.98 

59 

46 

0.36 

1.03 

0.21 

0.99 

0.09 

0.00 

0.44 

0.97 

40139 

-1.33 

58 

48 

0.38 

0.78 

-0.96 

0.52 

-1.28 

0.00 

0.57 

1.26 

40140 

-2.00 

57 

51 

0.45 

1.08 

0.35 

2.05 

1.63 

0.00 

0.13 

0.87 

40141 

-1.50 

58 

49 

0.39 

1.01 

0.11 

0.95 

0.08 

0.00 

0.33 

0.99 

40142 

-2.29 

60 

56 

0.57 

0.77 

-0.43 

0.43 

-0.51 

0.00 

0.48 

1.14 

40143 

0.00 

64 

64 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40144 

-3.46 

50 

48 

0.76 

1.14 

0.42 

0.58 

0.01 

-0.01 

0.23 

0.98 

40145 

-2.54 

56 

52 

0.55 

0.67 

-0.77 

0.25 

-1.21 

0.00 

0.54 

1.23 

40146 

-3.04 

55 

53 

0.76 

0.89 

0.01 

0.20 

-0.65 

-0.01 

0.38 

1.12 

40147 

-4.00 

54 

53 

1.02 

1.07 

0.38 

1.12 

0.55 

0.00 

0.06 

0.94 

40148 

-1.66 

57 

49 

0.44 

0.90 

-0.27 

0.87 

-0.07 

0.00 

0.50 

1.07 

40149 

-2.61 

59 

55 

0.61 

0.75 

-0.42 

0.29 

-0.73 

0.00 

0.59 

1.16 

40150 

-2.56 

56 

52 

0.55 

0.97 

0.06 

1.29 

0.60 

-0.01 

0.28 

1.00 

40151 

0.00 

48 

48 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40152 

-1.25 

59 

49 

0.37 

0.74 

-1.24 

0.51 

-1.12 

-0.01 

0.54 

1.30 

40153 

-4.22 

55 

54 

1.04 

0.75 

-0.01 

0.09 

-0.69 

-0.01 

0.32 

1.15 

40154 

-1.60 

56 

48 

0.41 

1.22 

0.92 

1.05 

0.28 

0.00 

0.21 

0.82 

40155 

-3.25 

65 

63 

0.76 

0.85 

-0.05 

0.27 

-0.57 

-0.01 

0.36 

1.11 

40156 

-2.38 

55 

50 

0.52 

0.59 

-1.18 

0.25 

-1.11 

0.00 

0.58 

1.28 

40157 

-1.21 

55 

45 

0.38 

0.94 

-0.24 

0.79 

-0.18 

-0.01 

0.39 

1.08 

40158 

-2.38 

56 

52 

0.54 

0.99 

0.12 

1.28 

0.59 

0.00 

0.18 

0.95 

40159 

-2.15 

57 

50 

0.45 

0.93 

-0.16 

0.64 

-0.37 

-0.01 

0.40 

1.09 

40160 

-2.30 

54 

49 

0.51 

0.79 

-0.54 

0.38 

-0.82 

0.00 

0.50 

1.18 

40161 

0.06 

45 

26 

0.37 

0.90 

-0.47 

0.80 

-0.56 

0.00 

0.63 

1.17 

40162 

-2.68 

54 

51 

0.61 

0.76 

-0.37 

0.26 

-0.95 

0.00 

0.39 

1.18 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40163 

0.86 

55 

28 

0.31 

0.74 

-2.09 

0.88 

-0.45 

0.00 

0.64 

1.50 

40164 

-1.01 

54 

43 

0.36 

0.96 

-0.12 

0.84 

-0.21 

0.00 

0.34 

1.06 

40165 

-0.77 

56 

44 

0.35 

0.83 

-0.97 

0.64 

-1.12 

0.00 

0.51 

1.27 

40166 

-0.73 

58 

45 

0.36 

1.17 

0.89 

1.54 

1.24 

0.00 

0.32 

0.72 

40167 

-1.06 

58 

48 

0.36 

0.86 

-0.62 

0.64 

-0.81 

0.00 

0.42 

1.19 

40168 

-0.49 

55 

41 

0.35 

0.96 

-0.18 

0.76 

-0.59 

0.00 

0.47 

1.11 

40169 

-0.69 

53 

41 

0.37 

1.15 

0.79 

1.78 

1.43 

0.00 

0.30 

0.69 

40170 

-1.57 

55 

48 

0.44 

0.93 

-0.17 

0.58 

-0.52 

-0.01 

0.41 

1.11 

40171 

0.05 

56 

35 

0.32 

1.00 

0.03 

1.04 

0.25 

0.00 

0.49 

0.97 

40172 

-0.54 

56 

40 

0.33 

0.85 

-1.06 

0.67 

-1.11 

0.00 

0.50 

1.33 

40173 

-1.07 

54 

42 

0.38 

1.05 

0.28 

0.82 

-0.28 

0.00 

0.48 

1.00 

40174 

-0.95 

67 

56 

0.36 

0.97 

-0.05 

1.13 

0.47 

0.00 

0.35 

0.99 

40175 

-0.49 

55 

38 

0.34 

0.70 

-2.10 

0.55 

-1.40 

0.00 

0.62 

1.55 

40176 

-0.91 

49 

37 

0.39 

0.91 

-0.42 

0.61 

-0.67 

0.00 

0.57 

1.19 

40177 

1.16 

51 

23 

0.34 

0.98 

-0.09 

0.84 

-0.58 

0.00 

0.56 

1.10 

40178 

1.32 

56 

22 

0.31 

0.85 

-1.16 

0.81 

-0.70 

0.00 

0.55 

1.34 

40179 

-0.33 

56 

39 

0.33 

1.03 

0.25 

1.05 

0.26 

0.00 

0.40 

0.92 

40180 

0.93 

56 

21 

0.31 

1.03 

0.27 

0.96 

-0.16 

0.00 

0.38 

0.97 

40181 

0.27 

273 

180 

0.14 

0.96 

-0.62 

1.00 

0.01 

0.00 

0.41 

1.07 

40182 

1.76 

60 

19 

0.32 

1.13 

0.85 

1.25 

1.10 

0.00 

0.37 

0.76 

40183 

0.28 

58 

35 

0.30 

1.04 

0.39 

0.97 

-0.08 

0.00 

0.45 

0.94 

40184 

3.33 

60 

8 

0.44 

1.29 

1.00 

1.03 

0.23 

0.00 

0.35 

0.83 

40185 

-0.03 

56 

34 

0.31 

0.97 

-0.16 

0.85 

-0.47 

0.00 

0.49 

1.11 

40186 

2.34 

62 

16 

0.32 

1.17 

1.08 

1.18 

0.61 

0.00 

0.25 

0.72 

40187 

0.38 

56 

29 

0.30 

0.91 

-0.71 

0.89 

-0.56 

0.00 

0.52 

1.22 

40188 

1.05 

56 

21 

0.32 

1.17 

1.22 

1.33 

1.01 

0.00 

0.38 

0.60 

40189 

-0.91 

56 

44 

0.36 

0.70 

-1.59 

0.52 

-1.35 

0.00 

0.57 

1.39 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40190 

0.18 

55 

35 

0.32 

0.98 

-0.12 

1.06 

0.33 

0.00 

0.46 

1.02 

40191 

-0.85 

58 

46 

0.35 

0.85 

-0.79 

0.59 

-0.87 

-0.01 

0.48 

1.25 

40192 

0.40 

58 

31 

0.30 

0.89 

-0.95 

0.85 

-0.84 

0.00 

0.51 

1.32 

40193 

-0.41 

59 

43 

0.33 

0.90 

-0.57 

0.87 

-0.36 

0.00 

0.49 

1.15 

40194 

1.03 

55 

24 

0.31 

1.10 

0.84 

1.09 

0.55 

0.00 

0.40 

0.76 

40195 

-0.56 

48 

34 

0.37 

0.88 

-0.64 

0.75 

-0.72 

0.00 

0.54 

1.21 

40196 

0.12 

71 

47 

0.27 

1.07 

0.65 

1.15 

0.94 

0.00 

0.24 

0.78 

40197 

-0.35 

58 

40 

0.32 

0.75 

-1.75 

0.67 

-0.97 

0.00 

0.61 

1.42 

40198 

0.75 

70 

39 

0.27 

1.09 

0.97 

1.25 

1.63 

0.00 

0.33 

0.61 

40199 

-0.31 

48 

34 

0.37 

0.90 

-0.46 

0.87 

-0.23 

0.00 

0.54 

1.13 

40200 

0.23 

60 

33 

0.29 

0.93 

-0.68 

0.82 

-0.78 

-0.01 

0.50 

1.27 

40201 

0.88 

58 

27 

0.30 

0.91 

-0.73 

0.87 

-0.54 

0.00 

0.48 

1.25 

40202 

-1.06 

60 

47 

0.34 

1.25 

1.30 

1.94 

1.93 

0.00 

0.16 

0.56 

40203 

1.27 

46 

21 

0.33 

0.71 

-2.51 

0.61 

-1.91 

0.00 

0.67 

1.81 

40204 

0.22 

54 

34 

0.31 

1.26 

1.87 

1.17 

0.79 

0.00 

0.24 

0.47 

40205 

0.47 

55 

30 

0.29 

0.88 

-1.19 

0.82 

-1.00 

0.00 

0.49 

1.46 

40206 

0.98 

53 

23 

0.31 

1.13 

1.06 

1.30 

1.20 

0.00 

0.35 

0.59 

40207 

0.16 

58 

37 

0.30 

1.13 

1.10 

1.38 

1.68 

0.00 

0.27 

0.57 

40208 

0.42 

54 

28 

0.31 

1.11 

0.88 

1.25 

1.11 

0.00 

0.40 

0.66 

40209 

0.42 

51 

30 

0.31 

1.03 

0.33 

1.14 

0.71 

0.00 

0.37 

0.85 

40210 

0.57 

61 

34 

0.29 

0.98 

-0.16 

0.97 

-0.13 

0.00 

0.43 

1.06 

40211 

1.97 

252 

92 

0.15 

0.99 

-0.17 

1.04 

0.40 

0.00 

0.42 

1.00 

40212 

1.61 

67 

21 

0.29 

1.02 

0.19 

1.14 

0.68 

0.00 

0.40 

0.93 

40213 

0.69 

57 

25 

0.29 

1.10 

0.94 

1.12 

0.81 

0.00 

0.32 

0.68 

40214 

3.45 

57 

6 

0.51 

1.15 

0.50 

1.34 

0.66 

0.00 

0.39 

0.89 

40215 

0.49 

56 

27 

0.31 

1.00 

0.04 

0.99 

0.03 

0.00 

0.49 

1.00 

40216 

2.58 

56 

10 

0.41 

0.97 

-0.05 

0.78 

-0.23 

0.00 

0.53 

1.05 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40217 

3.18 

56 

7 

0.44 

0.90 

-0.27 

0.92 

0.09 

0.00 

0.41 

1.07 

40218 

3.30 

49 

6 

0.50 

0.79 

-0.52 

0.91 

0.10 

0.00 

0.50 

1.11 

40219 

1.55 

56 

16 

0.33 

1.03 

0.27 

1.02 

0.15 

0.00 

0.41 

0.94 

40220 

2.56 

57 

10 

0.41 

1.10 

0.48 

1.28 

0.69 

0.00 

0.42 

0.87 

40221 

3.15 

54 

5 

0.50 

1.32 

0.92 

2.15 

1.52 

0.00 

-0.04 

0.71 

40222 

1.65 

57 

22 

0.31 

1.26 

1.69 

1.39 

1.77 

0.00 

0.31 

0.47 

40223 

1.72 

57 

18 

0.34 

1.07 

0.49 

1.32 

1.13 

0.00 

0.45 

0.83 

40224 

-0.38 

278 

225 

0.16 

1.04 

0.47 

1.11 

0.63 

0.00 

0.30 

0.94 

40225 

-0.20 

56 

37 

0.31 

1.04 

0.32 

0.92 

-0.24 

0.00 

0.42 

0.97 

40226 

-0.32 

48 

34 

0.36 

1.09 

0.56 

0.99 

0.08 

0.00 

0.39 

0.89 

40227 

0.79 

54 

26 

0.32 

1.05 

0.44 

1.49 

1.95 

0.00 

0.44 

0.75 

40228 

-1.40 

286 

261 

0.22 

1.13 

0.84 

1.67 

1.86 

0.00 

0.14 

0.86 

40229 

-1.85 

57 

51 

0.45 

0.92 

-0.16 

1.51 

0.93 

-0.01 

0.26 

1.00 

40230 

-2.48 

58 

53 

0.49 

0.91 

-0.15 

0.49 

-0.71 

0.00 

0.34 

1.11 

40231 

-0.05 

57 

35 

0.30 

1.00 

0.05 

1.04 

0.27 

0.00 

0.42 

0.97 

40232 

-0.36 

57 

42 

0.33 

0.92 

-0.45 

0.72 

-0.82 

0.00 

0.48 

1.19 

40233 

1.17 

50 

22 

0.32 

1.03 

0.31 

1.09 

0.53 

0.00 

0.40 

0.87 

40234 

-0.02 

56 

38 

0.32 

0.84 

-1.11 

0.78 

-0.96 

0.00 

0.56 

1.30 

40235 

-0.28 

51 

35 

0.34 

1.03 

0.23 

1.07 

0.35 

0.00 

0.41 

0.92 

40236 

-1.07 

56 

44 

0.36 

0.84 

-0.84 

0.74 

-0.76 

0.00 

0.45 

1.22 

40237 

-0.30 

60 

43 

0.31 

1.05 

0.41 

1.05 

0.28 

0.00 

0.32 

0.90 

40238 

-0.86 

57 

46 

0.36 

0.87 

-0.60 

1.01 

0.14 

0.00 

0.38 

1.11 

40239 

-0.95 

59 

46 

0.35 

0.99 

0.00 

0.81 

-0.36 

0.00 

0.42 

1.05 

40240 

-0.06 

64 

45 

0.29 

0.98 

-0.13 

0.91 

-0.42 

0.00 

0.35 

1.08 

40241 

0.06 

57 

34 

0.31 

0.80 

-1.62 

0.71 

-1.36 

0.00 

0.59 

1.46 

40242 

-0.73 

57 

43 

0.33 

0.81 

-1.12 

0.70 

-1.06 

0.00 

0.54 

1.29 

40243 

0.97 

58 

25 

0.30 

0.93 

-0.50 

0.86 

-0.59 

0.00 

0.53 

1.17 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40244 

0.49 

65 

41 

0.29 

0.79 

-1.93 

0.80 

-0.99 

0.00 

0.57 

1.49 

40245 

-1.16 

57 

47 

0.38 

0.93 

-0.25 

0.75 

-0.35 

0.00 

0.42 

1.10 

40246 

-1.50 

57 

48 

0.40 

0.82 

-0.72 

0.48 

-0.95 

-0.01 

0.51 

1.23 

40247 

-1.43 

272 

247 

0.23 

0.91 

-0.55 

0.58 

-1.45 

0.00 

0.41 

1.10 

40248 

0.01 

55 

36 

0.32 

0.69 

-2.34 

0.57 

-2.16 

0.00 

0.67 

1.61 

40249 

-0.94 

53 

41 

0.38 

0.77 

-1.09 

0.55 

-1.13 

0.00 

0.64 

1.28 

40250 

-1.30 

57 

46 

0.37 

1.05 

0.32 

0.78 

-0.33 

-0.01 

0.39 

1.00 

40251 

-1.34 

56 

48 

0.42 

0.94 

-0.12 

0.77 

-0.23 

0.00 

0.42 

1.06 

40252 

-0.93 

56 

44 

0.36 

1.18 

0.98 

1.01 

0.17 

0.00 

0.29 

0.81 

40253 

-2.43 

49 

47 

0.74 

1.01 

0.23 

0.71 

0.06 

0.00 

0.18 

1.01 

40254 

-1.32 

55 

48 

0.42 

0.85 

-0.47 

0.55 

-0.79 

0.00 

0.40 

1.17 

40255 

-1.61 

51 

47 

0.54 

0.88 

-0.17 

0.46 

-0.57 

0.00 

0.33 

1.13 

40256 

-1.76 

56 

48 

0.45 

0.84 

-0.48 

0.62 

-0.53 

0.00 

0.51 

1.14 

40257 

-0.71 

48 

35 

0.36 

1.10 

0.62 

1.31 

0.97 

0.00 

0.28 

0.76 

40258 

-3.81 

55 

54 

1.02 

1.02 

0.33 

0.59 

0.05 

0.00 

0.12 

1.01 

40259 

-3.80 

53 

52 

1.02 

1.04 

0.36 

1.00 

0.45 

0.00 

0.06 

0.97 

40260 

-2.03 

58 

53 

0.48 

0.97 

0.05 

0.59 

-0.48 

0.00 

0.31 

1.06 

40261 

-0.68 

57 

44 

0.34 

1.14 

0.84 

1.00 

0.15 

-0.01 

0.28 

0.82 

40262 

-2.36 

58 

53 

0.50 

1.05 

0.25 

1.83 

1.11 

0.00 

0.19 

0.88 

40263 

-1.26 

43 

37 

0.47 

0.99 

0.08 

1.42 

0.76 

-0.01 

0.25 

0.91 

40264 

-1.30 

58 

49 

0.40 

1.01 

0.11 

0.71 

-0.49 

0.00 

0.43 

1.05 

40265 

-0.96 

56 

43 

0.36 

1.23 

1.18 

1.39 

1.04 

0.00 

0.31 

0.66 

40266 

-1.07 

48 

39 

0.41 

1.00 

0.08 

0.84 

-0.29 

0.00 

0.41 

1.03 

40267 

-0.16 

59 

39 

0.30 

0.95 

-0.35 

0.91 

-0.36 

0.00 

0.45 

1.12 

40268 

-0.50 

57 

42 

0.33 

0.92 

-0.49 

0.90 

-0.19 

0.00 

0.41 

1.12 

40269 

-1.39 

59 

51 

0.41 

0.97 

-0.01 

0.96 

0.11 

0.00 

0.34 

1.01 

40270 

-2.30 

56 

51 

0.50 

0.82 

-0.44 

0.43 

-0.58 

0.00 

0.41 

1.16 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40271 

-1.34 

55 

47 

0.40 

0.97 

-0.04 

0.93 

-0.03 

-0.01 

0.31 

1.03 

40272 

-2.75 

58 

55 

0.61 

1.17 

0.50 

1.63 

0.89 

0.00 

0.02 

0.84 

40273 

-1.30 

55 

47 

0.41 

1.05 

0.26 

1.02 

0.19 

0.00 

0.26 

0.95 

40274 

-1.22 

54 

46 

0.41 

1.17 

0.72 

2.10 

1.82 

-0.01 

0.11 

0.74 

40275 

-1.94 

56 

50 

0.46 

0.99 

0.08 

0.73 

-0.09 

0.00 

0.30 

1.02 

40276 

-1.05 

55 

44 

0.37 

1.09 

0.52 

1.55 

1.29 

-0.01 

0.21 

0.77 

40277 

-1.30 

56 

49 

0.42 

0.86 

-0.44 

0.58 

-0.90 

0.00 

0.37 

1.16 

40278 

-1.70 

55 

48 

0.44 

1.01 

0.14 

1.09 

0.35 

0.00 

0.31 

0.98 

40279 

-1.31 

50 

42 

0.45 

0.86 

-0.42 

0.56 

-0.53 

0.00 

0.55 

1.16 

40280 

-1.90 

58 

52 

0.47 

0.81 

-0.53 

0.55 

-0.61 

0.00 

0.44 

1.15 

40281 

-0.90 

53 

41 

0.38 

1.11 

0.61 

1.37 

0.91 

0.00 

0.39 

0.80 

40282 

-1.02 

53 

43 

0.39 

0.93 

-0.21 

0.76 

-0.46 

0.00 

0.46 

1.09 

40283 

-0.73 

55 

42 

0.36 

0.92 

-0.36 

0.72 

-0.65 

0.00 

0.50 

1.15 

40284 

-3.32 

55 

51 

0.65 

1.09 

0.35 

0.49 

-0.17 

-0.01 

0.48 

1.00 

40285 

-3.24 

54 

51 

0.76 

1.10 

0.36 

3.28 

1.71 

-0.01 

0.41 

0.88 

40286 

0.00 

54 

54 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40287 

-2.28 

55 

50 

0.55 

1.00 

0.14 

0.89 

0.15 

0.00 

0.44 

0.98 

40288 

-3.90 

56 

55 

1.02 

1.06 

0.37 

1.25 

0.62 

0.00 

0.05 

0.94 

40289 

0.00 

52 

51 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40290 

-2.20 

55 

48 

0.51 

0.77 

-0.60 

0.37 

-1.04 

-0.01 

0.66 

1.20 

40291 

-1.38 

48 

43 

0.49 

0.83 

-0.41 

0.63 

-0.58 

0.00 

0.36 

1.14 

40292 

-3.91 

57 

56 

1.02 

0.91 

0.22 

0.24 

-0.36 

0.00 

0.23 

1.08 

40293 

-3.15 

51 

49 

0.78 

1.38 

0.74 

1.39 

0.68 

0.00 

0.05 

0.83 

40294 

0.53 

56 

31 

0.30 

1.24 

1.95 

1.50 

2.24 

0.00 

0.24 

0.26 

40295 

-0.87 

56 

46 

0.38 

0.81 

-0.93 

0.61 

-0.77 

0.00 

0.44 

1.26 

40296 

-1.64 

55 

49 

0.47 

0.82 

-0.51 

0.82 

-0.08 

0.00 

0.44 

1.11 

40297 

-0.89 

60 

47 

0.36 

0.86 

-0.66 

0.67 

-0.61 

0.00 

0.51 

1.19 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40298 

-1.07 

58 

46 

0.39 

1.24 

1.08 

1.28 

0.70 

0.00 

0.41 

0.75 

40299 

3.88 

56 

7 

0.54 

0.98 

0.07 

0.69 

-0.23 

0.00 

0.61 

1.04 

40300 

-0.57 

50 

37 

0.35 

1.01 

0.10 

0.91 

-0.23 

0.00 

0.37 

1.02 

40301 

-0.27 

64 

46 

0.31 

0.83 

-1.22 

0.75 

-0.84 

0.00 

0.53 

1.31 

40302 

-1.29 

60 

52 

0.42 

0.90 

-0.28 

0.66 

-0.45 

0.00 

0.44 

1.11 

40303 

-1.46 

55 

47 

0.43 

0.80 

-0.67 

0.56 

-0.76 

0.00 

0.50 

1.19 

40304 

-1.28 

69 

58 

0.38 

0.82 

-0.76 

0.52 

-0.84 

0.00 

0.53 

1.20 

40305 

-1.26 

54 

45 

0.39 

0.87 

-0.51 

0.72 

-0.56 

0.00 

0.41 

1.15 

40306 

-1.42 

65 

56 

0.39 

0.94 

-0.16 

1.12 

0.39 

0.00 

0.35 

1.04 

40307 

-1.60 

53 

47 

0.47 

1.31 

0.96 

1.32 

0.64 

0.00 

0.17 

0.77 

40308 

-3.03 

55 

52 

0.73 

1.02 

0.25 

0.72 

0.02 

0.00 

0.48 

1.00 

40309 

-0.72 

54 

41 

0.35 

0.92 

-0.39 

0.76 

-0.62 

0.00 

0.47 

1.14 

40310 

-2.01 

55 

49 

0.45 

1.07 

0.32 

0.89 

0.07 

0.00 

0.22 

0.96 

40311 

-0.91 

55 

46 

0.40 

0.88 

-0.46 

0.66 

-0.64 

0.00 

0.45 

1.15 

40312 

-2.16 

53 

48 

0.50 

0.83 

-0.42 

0.39 

-0.78 

-0.01 

0.43 

1.17 

40313 

0.40 

68 

41 

0.29 

0.75 

-2.08 

0.68 

-1.71 

0.00 

0.64 

1.51 

40314 

0.36 

68 

47 

0.29 

1.41 

2.77 

1.58 

2.25 

0.00 

0.11 

0.20 

40315 

-1.81 

56 

50 

0.45 

0.92 

-0.17 

0.60 

-0.61 

0.00 

0.39 

1.10 

40316 

0.01 

60 

40 

0.31 

1.12 

0.93 

1.10 

0.46 

0.00 

0.34 

0.74 

40317 

-1.16 

52 

42 

0.38 

0.77 

-1.17 

0.54 

-1.27 

-0.01 

0.52 

1.32 

40318 

-0.87 

48 

35 

0.37 

0.94 

-0.27 

0.77 

-0.69 

0.00 

0.51 

1.13 

40319 

-0.25 

51 

37 

0.35 

0.96 

-0.20 

0.89 

-0.29 

0.00 

0.41 

1.08 

40320 

-0.55 

55 

43 

0.36 

0.89 

-0.56 

0.86 

-0.26 

0.00 

0.46 

1.14 

40321 

-0.38 

48 

34 

0.36 

0.96 

-0.19 

0.84 

-0.35 

-0.01 

0.48 

1.09 

40322 

-1.24 

294 

266 

0.21 

0.99 

-0.02 

0.93 

-0.13 

0.00 

0.28 

1.00 

40323 

-0.32 

53 

36 

0.32 

0.87 

-0.92 

1.03 

0.21 

0.00 

0.46 

1.20 

40324 

-0.79 

51 

40 

0.39 

0.89 

-0.49 

1.03 

0.23 

0.00 

0.47 

1.09 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40325 

-0.75 

53 

40 

0.35 

0.98 

-0.10 

0.87 

-0.33 

0.00 

0.36 

1.07 

40326 

-1.74 

286 

266 

0.24 

0.87 

-0.67 

0.74 

-0.68 

0.00 

0.33 

1.08 

40327 

0.41 

54 

30 

0.31 

0.89 

-0.93 

0.97 

-0.13 

0.00 

0.50 

1.24 

40328 

0.68 

54 

27 

0.31 

0.88 

-1.04 

0.82 

-0.93 

0.00 

0.55 

1.35 

40329 

0.15 

65 

43 

0.31 

1.10 

0.70 

1.28 

0.98 

0.00 

0.43 

0.79 

40330 

2.41 

47 

13 

0.39 

1.29 

1.28 

2.07 

2.56 

0.00 

0.34 

0.56 

40331 

1.45 

57 

22 

0.31 

1.04 

0.35 

1.12 

0.56 

0.00 

0.44 

0.85 

40332 

2.31 

66 

19 

0.31 

0.75 

-1.77 

0.58 

-1.26 

0.00 

0.62 

1.44 

40333 

-0.63 

65 

50 

0.32 

0.90 

-0.60 

0.79 

-0.35 

-0.01 

0.44 

1.16 

40334 

0.75 

286 

168 

0.13 

1.07 

1.55 

1.10 

1.39 

0.00 

0.31 

0.76 

40335 

-1.59 

58 

53 

0.49 

1.10 

0.38 

2.46 

1.73 

0.00 

0.08 

0.86 

40336 

1.58 

46 

16 

0.34 

0.91 

-0.61 

0.87 

-0.50 

0.00 

0.50 

1.20 

40337 

0.92 

62 

28 

0.29 

0.93 

-0.51 

0.88 

-0.58 

0.00 

0.53 

1.16 

40338 

1.61 

250 

119 

0.14 

0.97 

-0.60 

0.97 

-0.44 

0.00 

0.44 

1.10 

40339 

-1.15 

56 

46 

0.37 

0.88 

-0.51 

0.81 

-0.41 

0.00 

0.44 

1.13 

40340 

-0.36 

267 

215 

0.17 

0.89 

-1.24 

0.72 

-1.66 

0.00 

0.46 

1.16 

40341 

-1.10 

52 

43 

0.39 

0.83 

-0.73 

0.58 

-0.86 

0.00 

0.44 

1.23 

40342 

-0.19 

55 

34 

0.33 

0.92 

-0.53 

0.92 

-0.22 

0.00 

0.56 

1.14 

40343 

-0.20 

52 

33 

0.32 

0.90 

-0.80 

0.82 

-0.73 

0.00 

0.49 

1.28 

40344 

0.75 

60 

30 

0.30 

0.85 

-1.14 

0.77 

-1.38 

0.00 

0.61 

1.35 

40345 

0.07 

48 

29 

0.33 

0.91 

-0.62 

0.84 

-0.68 

0.00 

0.53 

1.22 

40346 

0.09 

58 

37 

0.30 

0.80 

-1.66 

0.74 

-1.55 

0.00 

0.56 

1.50 

40347 

-0.47 

55 

42 

0.35 

1.02 

0.19 

0.93 

-0.14 

0.00 

0.43 

1.00 

40348 

1.02 

54 

26 

0.31 

0.92 

-0.64 

0.86 

-0.68 

0.00 

0.52 

1.23 

40349 

-0.70 

56 

45 

0.37 

0.78 

-1.03 

0.66 

-0.77 

0.00 

0.51 

1.25 

40350 

0.47 

54 

28 

0.30 

1.09 

0.91 

1.11 

0.68 

0.00 

0.33 

0.69 

40351 

-2.37 

54 

51 

0.60 

1.06 

0.28 

3.89 

2.36 

0.00 

-0.07 

0.85 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40352 

-3.52 

58 

56 

0.77 

0.71 

-0.32 

0.19 

-0.55 

0.00 

0.42 

1.16 

40353 

-3.24 

68 

66 

0.73 

1.07 

0.32 

1.11 

0.46 

0.00 

0.10 

0.94 

40354 

0.00 

70 

70 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40355 

-0.40 

55 

37 

0.32 

1.27 

1.75 

1.35 

1.30 

0.00 

0.24 

0.46 

40356 

-0.90 

51 

41 

0.39 

1.30 

1.38 

2.62 

2.63 

0.00 

0.10 

0.43 

40357 

-0.19 

50 

33 

0.33 

0.94 

-0.40 

0.85 

-0.59 

0.00 

0.48 

1.16 

40358 

-0.37 

64 

46 

0.31 

1.05 

0.35 

1.01 

0.12 

0.00 

0.38 

0.93 

40359 

-1.62 

70 

63 

0.47 

0.94 

-0.05 

0.82 

-0.09 

0.00 

0.45 

1.03 

40360 

-0.56 

55 

41 

0.34 

1.24 

1.43 

1.27 

0.82 

0.00 

0.16 

0.60 

40361 

0.66 

55 

30 

0.32 

0.94 

-0.42 

0.88 

-0.47 

0.00 

0.52 

1.17 

40362 

0.70 

55 

27 

0.31 

0.94 

-0.53 

0.85 

-0.76 

0.00 

0.49 

1.24 

40363 

1.71 

51 

19 

0.33 

0.97 

-0.18 

0.89 

-0.24 

0.00 

0.46 

1.09 

40364 

1.67 

55 

19 

0.32 

0.57 

-3.31 

0.47 

-2.66 

0.00 

0.68 

1.78 

40365 

-0.24 

72 

52 

0.30 

0.79 

-1.60 

0.88 

-0.29 

0.00 

0.55 

1.30 

40366 

0.20 

66 

44 

0.30 

0.82 

-1.35 

0.68 

-1.17 

0.00 

0.60 

1.35 

40367 

0.58 

260 

176 

0.15 

0.94 

-0.92 

0.90 

-0.98 

0.00 

0.44 

1.14 

40368 

2.40 

60 

12 

0.35 

0.96 

-0.14 

0.88 

-0.16 

0.00 

0.40 

1.06 

40369 

1.44 

57 

24 

0.31 

0.98 

-0.11 

0.99 

0.01 

0.00 

0.49 

1.03 

40370 

1.86 

57 

16 

0.32 

1.05 

0.36 

1.07 

0.35 

0.00 

0.35 

0.91 

40371 

2.13 

55 

14 

0.34 

0.91 

-0.47 

0.98 

0.01 

0.00 

0.48 

1.10 

40372 

-1.88 

48 

45 

0.62 

0.88 

-0.10 

0.40 

-0.56 

0.00 

0.34 

1.12 

40373 

-3.13 

55 

53 

0.74 

1.00 

0.20 

0.50 

-0.24 

-0.01 

0.24 

1.04 

40374 

-1.27 

54 

45 

0.41 

0.90 

-0.32 

1.48 

1.01 

0.00 

0.44 

1.00 

40375 

-0.26 

53 

36 

0.33 

0.98 

-0.11 

0.86 

-0.43 

0.00 

0.45 

1.08 

40376 

-0.37 

257 

208 

0.17 

0.94 

-0.61 

0.91 

-0.44 

0.00 

0.39 

1.07 

40377 

0.82 

50 

24 

0.33 

1.01 

0.11 

1.00 

0.09 

0.00 

0.49 

0.97 

40378 

-0.45 

65 

46 

0.32 

1.16 

1.06 

0.99 

0.07 

0.00 

0.42 

0.80 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40379 

0.65 

48 

29 

0.32 

1.00 

0.07 

0.96 

-0.06 

0.00 

0.37 

1.00 

40380 

0.64 

52 

28 

0.31 

1.02 

0.23 

1.03 

0.22 

0.00 

0.40 

0.92 

40381 

-0.74 

68 

55 

0.35 

1.05 

0.30 

2.03 

1.89 

0.00 

0.37 

0.90 

40382 

0.58 

55 

28 

0.32 

0.97 

-0.21 

0.84 

-0.62 

0.00 

0.54 

1.13 

40383 

2.46 

55 

11 

0.39 

1.08 

0.41 

0.92 

-0.05 

0.00 

0.44 

0.95 

40384 

0.15 

72 

49 

0.29 

0.85 

-1.08 

1.03 

0.19 

0.00 

0.54 

1.21 

40385 

0.86 

71 

36 

0.28 

1.17 

1.41 

1.51 

2.31 

0.00 

0.39 

0.50 

40386 

3.53 

53 

5 

0.50 

1.20 

0.62 

1.26 

0.61 

0.00 

0.17 

0.90 

40387 

1.93 

56 

18 

0.32 

0.89 

-0.73 

0.79 

-0.93 

0.00 

0.49 

1.24 

40388 

1.30 

49 

22 

0.32 

0.96 

-0.26 

0.94 

-0.20 

0.00 

0.45 

1.10 

40389 

2.00 

55 

19 

0.32 

0.96 

-0.23 

0.93 

-0.23 

0.00 

0.47 

1.09 

40390 

-0.05 

62 

43 

0.31 

0.81 

-1.34 

0.67 

-1.34 

0.00 

0.56 

1.37 

40391 

-1.88 

55 

49 

0.48 

0.94 

-0.07 

0.85 

0.06 

0.00 

0.37 

1.03 

40392 

-3.25 

45 

44 

1.02 

0.86 

0.15 

0.19 

-0.43 

0.00 

0.31 

1.11 

40393 

-1.70 

63 

58 

0.49 

1.19 

0.61 

1.32 

0.63 

-0.01 

0.16 

0.87 

40394 

-2.04 

56 

51 

0.50 

0.94 

-0.08 

0.62 

-0.37 

-0.01 

0.35 

1.08 

40395 

-3.08 

55 

53 

0.74 

0.84 

-0.06 

0.26 

-0.55 

0.00 

0.33 

1.12 

40396 

-2.50 

55 

52 

0.61 

1.01 

0.18 

0.89 

0.20 

0.00 

0.18 

1.00 

40397 

-2.22 

56 

51 

0.50 

1.07 

0.31 

0.70 

-0.17 

0.00 

0.30 

1.00 

40398 

-1.69 

56 

49 

0.44 

0.72 

-0.94 

0.43 

-1.12 

0.00 

0.53 

1.25 

40399 

-1.96 

55 

49 

0.47 

0.63 

-1.26 

0.30 

-1.20 

0.00 

0.59 

1.30 

40400 

-2.06 

55 

51 

0.54 

0.84 

-0.26 

0.48 

-0.63 

0.00 

0.38 

1.12 

40401 

0.41 

55 

29 

0.31 

0.89 

-0.91 

0.86 

-0.61 

0.00 

0.55 

1.27 

40402 

0.40 

55 

32 

0.31 

1.14 

1.10 

1.08 

0.43 

0.00 

0.39 

0.70 

40403 

0.81 

55 

26 

0.32 

1.07 

0.57 

1.09 

0.49 

0.00 

0.47 

0.82 

40404 

0.60 

55 

29 

0.31 

1.15 

1.26 

1.16 

0.80 

0.00 

0.37 

0.61 

40405 

1.31 

61 

20 

0.29 

1.12 

0.97 

1.21 

1.16 

0.00 

0.22 

0.68 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40406 

1.63 

55 

17 

0.34 

0.86 

-0.79 

0.78 

-0.61 

0.00 

0.53 

1.23 

40407 

0.66 

53 

29 

0.31 

1.05 

0.50 

1.13 

0.61 

0.00 

0.40 

0.77 

40408 

1.17 

59 

23 

0.30 

1.06 

0.56 

1.11 

0.62 

0.00 

0.37 

0.82 

40409 

1.76 

64 

21 

0.30 

0.91 

-0.64 

1.04 

0.23 

0.00 

0.47 

1.14 

40410 

-3.76 

55 

54 

1.02 

1.02 

0.33 

0.54 

0.03 

0.00 

0.14 

1.01 

40411 

-2.48 

55 

50 

0.54 

0.66 

-0.81 

0.28 

-1.10 

0.00 

0.64 

1.23 

40412 

-2.69 

56 

52 

0.58 

1.15 

0.49 

1.36 

0.66 

-0.01 

0.26 

0.89 

40413 

-3.34 

54 

51 

0.79 

0.72 

-0.30 

0.22 

-0.58 

0.00 

0.53 

1.16 

40414 

-2.75 

55 

53 

0.73 

0.92 

0.09 

0.35 

-0.50 

0.00 

0.28 

1.08 

40415 

-2.40 

53 

48 

0.54 

1.20 

0.60 

2.26 

1.44 

0.00 

0.24 

0.78 

40416 

0.00 

55 

55 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40417 

-2.79 

48 

46 

0.75 

1.02 

0.23 

0.40 

-0.36 

0.00 

0.29 

1.05 

40418 

-3.06 

56 

54 

0.75 

0.72 

-0.30 

0.19 

-0.67 

-0.01 

0.40 

1.17 

40419 

-1.33 

61 

53 

0.40 

1.07 

0.35 

0.95 

0.06 

0.00 

0.28 

0.95 

40420 

-1.64 

54 

46 

0.43 

0.82 

-0.61 

0.64 

-0.57 

0.00 

0.55 

1.18 

40421 

-3.25 

65 

63 

0.74 

1.12 

0.40 

2.98 

1.56 

0.00 

0.01 

0.84 

40422 

-0.87 

47 

40 

0.46 

1.40 

1.31 

2.14 

1.66 

0.00 

0.10 

0.56 

40423 

-1.10 

55 

43 

0.38 

1.29 

1.32 

2.11 

1.71 

0.00 

0.28 

0.56 

40424 

-1.36 

54 

47 

0.43 

1.16 

0.63 

1.55 

1.20 

0.00 

0.10 

0.83 

40425 

-0.70 

57 

42 

0.34 

0.93 

-0.36 

1.16 

0.58 

0.00 

0.44 

1.04 

40426 

-1.53 

55 

47 

0.41 

1.07 

0.35 

0.99 

0.17 

0.00 

0.27 

0.93 

40427 

0.16 

56 

32 

0.30 

1.08 

0.71 

1.01 

0.10 

0.00 

0.36 

0.83 

40428 

-0.14 

59 

34 

0.30 

1.26 

2.24 

1.31 

1.83 

0.00 

0.30 

0.21 

40429 

1.36 

54 

24 

0.31 

1.17 

1.31 

1.12 

0.68 

0.00 

0.34 

0.63 

40430 

0.55 

63 

35 

0.29 

1.17 

1.60 

1.19 

0.82 

0.00 

0.34 

0.49 

40431 

0.62 

57 

29 

0.30 

1.11 

0.88 

1.22 

1.23 

0.00 

0.39 

0.70 

40432 

0.86 

48 

26 

0.31 

1.14 

1.39 

1.18 

1.15 

0.00 

0.23 

0.36 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40433 

0.01 

57 

35 

0.31 

1.23 

1.73 

1.37 

1.60 

0.00 

0.30 

0.43 

40434 

0.80 

55 

26 

0.30 

0.93 

-0.54 

0.86 

-0.67 

0.00 

0.51 

1.21 

40435 

0.24 

64 

39 

0.29 

0.98 

-0.17 

1.01 

0.12 

0.00 

0.44 

1.02 

40436 

2.05 

54 

12 

0.36 

1.12 

0.61 

1.14 

0.52 

0.00 

0.32 

0.86 

40437 

0.31 

59 

33 

0.29 

0.93 

-0.62 

1.00 

0.07 

0.00 

0.46 

1.15 

40438 

1.23 

49 

23 

0.32 

1.23 

1.87 

1.45 

2.16 

0.00 

0.24 

0.19 

40439 

0.61 

48 

28 

0.33 

1.32 

2.34 

1.35 

1.25 

0.00 

0.25 

0.16 

40440 

2.15 

55 

14 

0.35 

1.25 

1.36 

1.51 

1.46 

0.00 

0.20 

0.56 

40441 

-0.55 

50 

35 

0.35 

1.01 

0.14 

0.83 

-0.33 

0.00 

0.45 

1.03 

40442 

1.41 

47 

16 

0.36 

1.37 

2.18 

1.88 

2.58 

0.00 

0.25 

0.13 

40443 

-1.95 

56 

51 

0.49 

0.80 

-0.48 

0.44 

-0.63 

0.00 

0.38 

1.17 

40444 

-1.15 

49 

41 

0.42 

0.96 

-0.08 

0.79 

-0.23 

0.00 

0.39 

1.07 

40445 

-2.12 

57 

50 

0.46 

0.72 

-1.01 

0.38 

-0.88 

-0.01 

0.57 

1.26 

40446 

-3.45 

48 

46 

1.02 

1.02 

0.34 

0.84 

0.31 

0.00 

0.44 

0.98 

40447 

-2.58 

55 

51 

0.56 

1.07 

0.31 

0.99 

0.27 

0.00 

0.26 

0.96 

40448 

-2.29 

55 

51 

0.54 

1.14 

0.45 

1.49 

0.83 

0.00 

0.06 

0.87 

40449 

-1.14 

55 

44 

0.37 

0.79 

-1.05 

0.55 

-1.19 

0.00 

0.54 

1.30 

40450 

-2.39 

57 

53 

0.60 

1.00 

0.16 

0.68 

-0.16 

0.00 

0.45 

1.02 

40451 

-1.08 

56 

45 

0.37 

1.07 

0.41 

0.99 

0.11 

0.00 

0.36 

0.94 

40452 

-0.94 

56 

44 

0.37 

1.01 

0.14 

1.13 

0.42 

-0.01 

0.40 

0.92 

40453 

-1.91 

57 

50 

0.47 

0.67 

-1.07 

0.33 

-1.11 

0.00 

0.64 

1.27 

40454 

-0.83 

244 

207 

0.19 

0.97 

-0.20 

0.74 

-1.24 

0.00 

0.34 

1.07 

40455 

-1.88 

56 

49 

0.44 

1.18 

0.72 

0.83 

-0.07 

-0.01 

0.27 

0.90 

40456 

-2.10 

59 

51 

0.43 

0.99 

0.07 

0.94 

0.06 

0.00 

0.41 

1.00 

40457 

-1.35 

60 

50 

0.38 

0.92 

-0.27 

0.71 

-0.47 

0.00 

0.45 

1.10 

40458 

-0.73 

55 

40 

0.34 

0.89 

-0.66 

0.70 

-0.73 

0.00 

0.52 

1.23 

40459 

-0.16 

48 

32 

0.36 

0.98 

-0.09 

0.82 

-0.42 

0.00 

0.51 

1.09 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40460 

-0.55 

55 

39 

0.34 

0.89 

-0.68 

0.74 

-0.73 

0.00 

0.55 

1.21 

40461 

-0.61 

58 

41 

0.32 

0.94 

-0.40 

0.91 

-0.36 

0.00 

0.44 

1.13 

40462 

0.10 

55 

34 

0.31 

1.16 

1.34 

1.38 

1.86 

0.00 

0.27 

0.45 

40463 

-0.72 

55 

43 

0.35 

0.89 

-0.57 

0.71 

-0.52 

0.00 

0.41 

1.19 

40464 

-1.86 

55 

50 

0.49 

0.84 

-0.36 

0.54 

-0.59 

0.00 

0.40 

1.13 

40465 

-1.83 

49 

44 

0.50 

0.93 

-0.11 

0.59 

-0.39 

-0.01 

0.34 

1.09 

40466 

-1.13 

52 

44 

0.41 

0.85 

-0.56 

0.72 

-0.41 

0.00 

0.44 

1.15 

40467 

-3.02 

59 

57 

0.75 

0.71 

-0.31 

0.18 

-0.79 

0.00 

0.46 

1.17 

40468 

-2.70 

49 

46 

0.65 

0.50 

-1.12 

0.14 

-1.08 

-0.01 

0.58 

1.29 

40469 

-1.93 

54 

48 

0.46 

0.87 

-0.32 

0.65 

-0.44 

0.00 

0.41 

1.11 

40470 

-2.16 

55 

50 

0.50 

1.20 

0.66 

1.33 

0.64 

0.00 

0.15 

0.83 

40471 

-2.23 

57 

52 

0.50 

1.11 

0.43 

0.88 

0.09 

0.00 

0.25 

0.94 

40472 

-3.07 

49 

47 

0.74 

0.80 

-0.13 

0.25 

-0.79 

0.00 

0.39 

1.15 

40473 

-2.70 

55 

51 

0.55 

0.80 

-0.38 

0.39 

-0.68 

0.00 

0.40 

1.15 

40474 

-1.79 

49 

43 

0.46 

0.76 

-0.75 

0.49 

-0.85 

0.00 

0.50 

1.22 

40475 

-2.00 

57 

51 

0.46 

1.23 

0.80 

1.56 

0.90 

-0.01 

0.13 

0.77 

40476 

0.84 

56 

25 

0.30 

1.48 

3.96 

1.70 

3.84 

0.00 

0.02 

-0.62 

40477 

-0.23 

55 

37 

0.32 

0.75 

-1.90 

0.64 

-1.30 

0.00 

0.62 

1.53 

40478 

-0.20 

54 

39 

0.34 

0.71 

-1.98 

0.56 

-1.75 

0.00 

0.66 

1.52 

40479 

0.67 

56 

26 

0.29 

1.01 

0.14 

1.01 

0.09 

0.00 

0.38 

0.97 

40480 

-0.35 

58 

40 

0.32 

0.90 

-0.66 

0.88 

-0.30 

0.00 

0.49 

1.18 

40481 

0.24 

51 

30 

0.31 

0.93 

-0.54 

0.92 

-0.41 

0.00 

0.46 

1.19 

40482 

0.40 

58 

32 

0.30 

0.76 

-1.96 

0.73 

-1.63 

0.00 

0.63 

1.53 

40483 

-2.11 

55 

50 

0.49 

1.16 

0.56 

1.43 

0.83 

-0.01 

0.09 

0.85 

40484 

0.07 

52 

31 

0.31 

0.99 

-0.02 

0.93 

-0.37 

0.00 

0.43 

1.06 

40485 

-0.01 

53 

31 

0.32 

1.12 

1.00 

0.99 

0.08 

0.00 

0.43 

0.77 

40486 

-0.83 

54 

40 

0.35 

0.80 

-1.20 

0.60 

-1.20 

0.00 

0.60 

1.32 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40487 

0.07 

55 

34 

0.31 

0.80 

-1.60 

0.70 

-1.06 

0.00 

0.59 

1.46 

40488 

-0.81 

49 

36 

0.38 

0.75 

-1.36 

0.53 

-1.04 

0.00 

0.62 

1.39 

40489 

-2.01 

48 

41 

0.49 

0.71 

-1.00 

0.32 

-0.93 

-0.01 

0.66 

1.28 

40490 

-1.16 

54 

45 

0.40 

1.07 

0.36 

1.03 

0.23 

0.00 

0.30 

0.93 

40491 

0.52 

55 

31 

0.32 

0.91 

-0.60 

1.36 

1.43 

0.00 

0.52 

1.05 

40492 

-0.28 

55 

39 

0.33 

1.06 

0.46 

1.11 

0.48 

0.00 

0.33 

0.85 

40493 

1.86 

55 

17 

0.33 

0.95 

-0.26 

1.08 

0.35 

0.00 

0.44 

1.02 

40494 

-0.05 

59 

34 

0.29 

1.12 

1.12 

1.11 

0.65 

0.00 

0.32 

0.66 

40495 

-2.16 

54 

48 

0.48 

0.92 

-0.14 

0.51 

-0.57 

0.00 

0.45 

1.11 

40496 

-0.52 

55 

39 

0.32 

0.96 

-0.23 

1.45 

1.41 

0.00 

0.37 

0.97 

40497 

-1.46 

53 

43 

0.41 

0.91 

-0.29 

0.63 

-0.49 

-0.01 

0.53 

1.13 

40498 

0.49 

53 

29 

0.31 

0.82 

-1.63 

1.07 

0.39 

0.00 

0.54 

1.40 

40499 

-1.61 

55 

47 

0.42 

0.74 

-0.95 

0.49 

-0.97 

0.00 

0.55 

1.25 

40500 

-0.32 

55 

39 

0.34 

1.24 

1.49 

1.46 

1.36 

0.00 

0.27 

0.55 

40501 

0.32 

55 

32 

0.32 

0.85 

-1.04 

1.04 

0.24 

0.00 

0.61 

1.24 

40502 

-1.08 

54 

46 

0.41 

0.87 

-0.44 

1.11 

0.39 

0.00 

0.41 

1.09 

40503 

-0.48 

57 

40 

0.34 

0.78 

-1.42 

0.60 

-1.40 

0.00 

0.60 

1.38 

40504 

-0.97 

55 

44 

0.36 

0.95 

-0.21 

0.70 

-0.68 

0.00 

0.43 

1.12 

40505 

-0.70 

59 

43 

0.32 

0.72 

-1.86 

0.57 

-1.81 

0.00 

0.66 

1.45 

40506 

-0.43 

54 

40 

0.35 

1.00 

0.03 

1.00 

0.12 

0.00 

0.44 

1.00 

40507 

-0.22 

55 

36 

0.31 

1.10 

0.76 

1.23 

1.04 

0.00 

0.33 

0.74 

40508 

-0.50 

267 

213 

0.16 

0.83 

-1.92 

0.69 

-2.11 

0.00 

0.51 

1.22 

40509 

0.25 

57 

34 

0.31 

0.75 

-2.04 

0.66 

-2.03 

0.00 

0.67 

1.57 

40510 

1.79 

55 

16 

0.33 

1.02 

0.21 

1.16 

0.63 

0.00 

0.38 

0.90 

40511 

-0.50 

55 

39 

0.34 

0.99 

0.01 

1.21 

0.72 

0.00 

0.46 

0.99 

40512 

0.14 

56 

33 

0.30 

0.92 

-0.66 

0.83 

-0.94 

0.00 

0.49 

1.27 

40513 

0.90 

54 

25 

0.33 

0.88 

-0.80 

0.85 

-0.27 

0.00 

0.57 

1.22 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40514 

0.16 

49 

30 

0.33 

1.33 

2.26 

1.25 

0.93 

-0.01 

0.26 

0.28 

40515 

-0.86 

55 

43 

0.36 

0.92 

-0.39 

1.81 

1.54 

0.00 

0.35 

0.98 

40516 

-0.09 

55 

35 

0.32 

1.23 

1.63 

2.18 

3.39 

0.00 

0.26 

0.38 

40517 

-2.08 

54 

50 

0.54 

1.16 

0.52 

1.38 

0.68 

0.00 

0.08 

0.85 

40518 

-2.75 

55 

52 

0.63 

0.77 

-0.35 

0.30 

-0.73 

0.00 

0.41 

1.16 

40519 

0.26 

55 

34 

0.32 

1.18 

1.31 

1.12 

0.47 

0.00 

0.37 

0.65 

40520 

-0.03 

54 

35 

0.32 

1.30 

1.94 

1.71 

2.63 

0.00 

0.19 

0.29 

40521 

-1.04 

62 

51 

0.36 

0.82 

-0.84 

0.68 

-0.64 

0.00 

0.47 

1.20 

40522 

1.60 

53 

23 

0.32 

0.83 

-1.30 

0.75 

-1.22 

0.00 

0.62 

1.40 

40523 

0.80 

55 

26 

0.32 

0.67 

-2.60 

0.57 

-2.42 

0.00 

0.72 

1.67 

40524 

-1.31 

57 

47 

0.38 

0.82 

-0.76 

0.69 

-0.60 

0.00 

0.49 

1.19 

40525 

0.38 

54 

28 

0.31 

0.87 

-1.13 

0.78 

-0.97 

0.00 

0.56 

1.38 

40526 

1.81 

50 

14 

0.36 

0.79 

-1.11 

0.71 

-0.93 

0.00 

0.63 

1.28 

40527 

-3.95 

60 

59 

1.01 

0.97 

0.28 

0.36 

-0.21 

0.00 

0.18 

1.05 

40528 

-2.73 

54 

51 

0.62 

0.76 

-0.39 

0.25 

-0.87 

-0.01 

0.46 

1.18 

40529 

-1.24 

60 

51 

0.39 

0.85 

-0.56 

2.68 

2.26 

0.00 

0.38 

1.05 

40530 

-1.91 

61 

55 

0.45 

0.88 

-0.29 

0.42 

-0.92 

0.00 

0.44 

1.15 

40531 

2.02 

51 

15 

0.35 

0.98 

-0.09 

1.40 

1.30 

0.00 

0.42 

0.93 

40532 

1.67 

61 

21 

0.30 

1.04 

0.31 

1.18 

0.90 

0.00 

0.40 

0.88 

40533 

0.85 

55 

22 

0.32 

0.94 

-0.35 

0.86 

-0.64 

0.00 

0.50 

1.14 

40534 

0.13 

55 

35 

0.31 

0.95 

-0.33 

0.87 

-0.54 

0.00 

0.47 

1.14 

40535 

0.51 

54 

27 

0.31 

0.90 

-0.87 

0.83 

-0.85 

0.00 

0.54 

1.29 

40536 

0.34 

55 

33 

0.31 

0.98 

-0.17 

0.91 

-0.52 

0.00 

0.44 

1.12 

40537 

1.59 

50 

18 

0.33 

0.95 

-0.32 

0.85 

-0.67 

0.00 

0.48 

1.16 

40538 

-0.25 

67 

45 

0.28 

0.98 

-0.16 

0.85 

-0.50 

0.00 

0.40 

1.11 

40539 

1.31 

54 

24 

0.31 

1.02 

0.23 

1.10 

0.60 

0.00 

0.43 

0.92 

40540 

0.94 

57 

27 

0.30 

0.73 

-2.31 

0.68 

-1.92 

0.00 

0.67 

1.63 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40541 

-1.57 

57 

48 

0.39 

0.96 

-0.08 

0.78 

-0.35 

0.00 

0.38 

1.06 

40542 

0.02 

60 

36 

0.30 

0.89 

-0.94 

0.82 

-0.82 

0.00 

0.53 

1.29 

40543 

-2.16 

52 

48 

0.54 

0.90 

-0.11 

0.67 

-0.32 

0.00 

0.32 

1.07 

40544 

-0.91 

52 

41 

0.36 

0.86 

-0.70 

0.72 

-0.81 

0.00 

0.42 

1.21 

40545 

-0.99 

49 

40 

0.39 

1.05 

0.31 

1.31 

0.81 

0.00 

0.21 

0.89 

40546 

-0.28 

290 

230 

0.16 

0.87 

-1.50 

0.69 

-1.80 

0.00 

0.49 

1.19 

40547 

0.28 

49 

26 

0.31 

0.79 

-1.87 

0.79 

-1.56 

0.00 

0.61 

1.62 

40548 

-0.91 

51 

39 

0.35 

0.99 

0.02 

0.81 

-0.51 

0.00 

0.38 

1.07 

40549 

-1.61 

52 

46 

0.45 

1.04 

0.22 

1.07 

0.32 

0.00 

0.20 

0.97 

40550 

0.53 

48 

28 

0.33 

0.82 

-1.36 

0.80 

-0.81 

0.00 

0.59 

1.39 

40551 

-2.33 

42 

40 

0.74 

0.92 

0.08 

0.42 

-0.29 

0.00 

0.25 

1.09 

40552 

-1.31 

67 

58 

0.38 

0.99 

0.05 

1.16 

0.48 

0.00 

0.26 

0.99 

40553 

-0.52 

56 

40 

0.33 

0.86 

-0.86 

0.74 

-0.93 

0.00 

0.53 

1.27 

40554 

-2.75 

49 

47 

0.73 

0.96 

0.14 

2.52 

1.37 

0.00 

0.09 

0.95 

40555 

-2.34 

66 

62 

0.55 

0.82 

-0.30 

0.40 

-0.67 

0.00 

0.42 

1.13 

40556 

-2.50 

50 

47 

0.65 

0.80 

-0.23 

0.47 

-0.40 

0.00 

0.40 

1.11 

40557 

-0.62 

58 

42 

0.33 

1.19 

1.18 

1.27 

0.85 

0.00 

0.29 

0.68 

40558 

-2.63 

54 

51 

0.65 

0.88 

-0.05 

1.18 

0.50 

0.00 

0.31 

1.01 

40559 

-1.70 

52 

47 

0.50 

1.00 

0.11 

1.02 

0.29 

-0.01 

0.25 

0.98 

40560 

-3.20 

56 

54 

0.74 

1.01 

0.23 

1.19 

0.52 

0.00 

0.15 

0.98 

40561 

-0.20 

57 

35 

0.31 

0.89 

-0.88 

0.80 

-0.86 

0.00 

0.53 

1.29 

40562 

-0.07 

53 

36 

0.34 

0.84 

-1.03 

0.70 

-0.87 

0.00 

0.56 

1.32 

40563 

1.54 

70 

27 

0.27 

0.80 

-2.00 

0.73 

-2.14 

0.00 

0.60 

1.57 

40564 

-4.10 

58 

57 

1.03 

0.87 

0.16 

0.15 

-0.52 

0.00 

0.31 

1.11 

40565 

-1.47 

62 

54 

0.40 

0.99 

0.05 

1.13 

0.41 

-0.01 

0.26 

0.97 

40566 

-2.85 

50 

48 

0.75 

0.80 

-0.15 

0.32 

-0.52 

0.00 

0.39 

1.13 

40567 

-2.16 

60 

54 

0.46 

0.96 

-0.02 

0.96 

0.16 

-0.01 

0.31 

1.01 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40568 

-2.65 

66 

62 

0.54 

0.96 

0.04 

0.77 

-0.05 

0.00 

0.24 

1.02 

40569 

-1.02 

56 

43 

0.35 

0.85 

-0.82 

0.78 

-0.51 

0.00 

0.49 

1.20 

40570 

-1.78 

60 

54 

0.44 

0.98 

0.03 

0.71 

-0.31 

0.00 

0.28 

1.04 

40571 

-1.22 

58 

50 

0.40 

1.12 

0.53 

0.93 

0.01 

0.00 

0.18 

0.93 

40572 

-2.80 

51 

49 

0.74 

1.00 

0.20 

0.59 

-0.05 

0.00 

0.20 

1.03 

40573 

-2.34 

51 

46 

0.54 

0.93 

-0.06 

0.59 

-0.32 

0.00 

0.47 

1.07 

40574 

-2.39 

55 

51 

0.54 

0.91 

-0.09 

0.53 

-0.43 

0.00 

0.32 

1.09 

40575 

-2.49 

50 

48 

0.73 

0.95 

0.13 

0.55 

-0.26 

0.00 

0.22 

1.05 

40576 

0.92 

60 

29 

0.30 

1.02 

0.23 

1.02 

0.16 

0.00 

0.47 

0.95 

40577 

-0.37 

62 

45 

0.32 

1.10 

0.65 

1.15 

0.63 

0.00 

0.34 

0.83 

40578 

0.16 

56 

36 

0.31 

1.07 

0.56 

0.95 

-0.15 

0.00 

0.41 

0.91 

40579 

0.86 

62 

28 

0.29 

1.07 

0.61 

1.20 

1.13 

0.00 

0.39 

0.75 

40580 

-1.77 

51 

46 

0.49 

0.77 

-0.59 

0.42 

-0.89 

0.00 

0.45 

1.20 

40581 

-1.71 

54 

47 

0.44 

0.86 

-0.42 

0.64 

-0.68 

0.00 

0.48 

1.14 

40582 

-1.85 

50 

44 

0.52 

0.99 

0.10 

0.77 

-0.17 

0.00 

0.46 

1.02 

40583 

1.05 

63 

31 

0.28 

1.41 

3.47 

1.53 

2.54 

0.00 

0.11 

-0.22 

40584 

0.85 

51 

27 

0.31 

1.30 

2.66 

1.35 

2.03 

0.00 

0.16 

-0.06 

40585 

-3.05 

51 

49 

0.76 

0.81 

-0.13 

0.36 

-0.30 

0.00 

0.36 

1.11 

40586 

-2.22 

52 

48 

0.61 

0.88 

-0.09 

0.43 

-0.53 

0.00 

0.48 

1.11 

40587 

-0.66 

55 

43 

0.36 

0.82 

-1.00 

0.62 

-0.77 

0.00 

0.48 

1.28 

40588 

-0.12 

49 

33 

0.35 

1.02 

0.19 

0.89 

-0.21 

0.00 

0.46 

1.00 

40589 

-1.49 

54 

45 

0.41 

0.92 

-0.26 

0.66 

-0.63 

0.00 

0.51 

1.12 

40590 

-0.79 

51 

39 

0.36 

0.75 

-1.50 

0.57 

-1.32 

0.00 

0.53 

1.43 

40591 

-1.28 

60 

50 

0.37 

0.93 

-0.27 

0.82 

-0.29 

-0.01 

0.40 

1.08 

40592 

-0.89 

49 

40 

0.42 

0.87 

-0.46 

0.74 

-0.42 

0.00 

0.53 

1.13 

40593 

-1.00 

54 

43 

0.37 

0.87 

-0.61 

0.73 

-0.50 

0.00 

0.45 

1.17 

40594 

-1.99 

57 

51 

0.45 

1.00 

0.09 

1.21 

0.51 

0.00 

0.21 

0.97 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40595 

-2.05 

51 

46 

0.50 

0.66 

-1.05 

0.27 

-0.87 

-0.01 

0.51 

1.29 

40596 

-0.45 

51 

36 

0.34 

0.88 

-0.82 

0.79 

-0.78 

0.00 

0.47 

1.27 

40597 

-0.05 

57 

38 

0.32 

1.12 

0.89 

1.16 

0.73 

0.00 

0.34 

0.74 

40598 

-0.18 

48 

37 

0.37 

1.14 

0.79 

1.00 

0.12 

0.00 

0.21 

0.84 

40599 

-0.25 

53 

36 

0.34 

0.74 

-1.79 

0.59 

-1.68 

0.00 

0.63 

1.50 

40600 

1.58 

53 

17 

0.32 

1.10 

0.75 

1.14 

0.55 

0.00 

0.26 

0.76 

40602 

-1.88 

55 

50 

0.49 

1.09 

0.37 

1.50 

0.86 

0.00 

0.12 

0.89 

40603 

-1.56 

59 

52 

0.43 

0.81 

-0.60 

0.58 

-0.70 

0.00 

0.45 

1.16 

40604 

-2.08 

54 

49 

0.49 

0.76 

-0.63 

0.35 

-0.94 

-0.01 

0.44 

1.21 

40605 

-1.86 

49 

44 

0.50 

0.98 

0.06 

0.83 

-0.06 

-0.01 

0.28 

1.01 

40606 

-0.25 

55 

37 

0.31 

1.15 

1.10 

1.14 

0.64 

0.00 

0.27 

0.69 

40607 

0.69 

64 

31 

0.29 

1.03 

0.33 

1.22 

1.20 

0.00 

0.43 

0.83 

40608 

-1.82 

50 

45 

0.49 

1.02 

0.19 

0.65 

-0.48 

0.00 

0.30 

1.04 

40609 

-2.19 

62 

57 

0.49 

1.00 

0.13 

0.75 

-0.07 

-0.01 

0.25 

1.01 

40610 

-1.26 

51 

43 

0.41 

0.88 

-0.41 

0.67 

-0.63 

0.00 

0.40 

1.15 

40611 

-3.00 

54 

52 

0.74 

1.10 

0.36 

0.75 

0.08 

-0.01 

0.15 

0.97 

40612 

-1.21 

249 

220 

0.21 

0.92 

-0.51 

0.68 

-1.24 

0.00 

0.36 

1.09 

40613 

-1.51 

69 

60 

0.39 

0.91 

-0.26 

0.59 

-0.78 

0.00 

0.43 

1.12 

40614 

-2.21 

49 

46 

0.61 

0.95 

0.05 

1.59 

0.90 

0.00 

0.15 

0.98 

40615 

0.13 

159 

117 

0.20 

0.95 

-0.52 

1.01 

0.10 

0.00 

0.40 

1.08 

40616 

-2.69 

56 

52 

0.63 

0.87 

-0.09 

0.66 

-0.10 

0.00 

0.55 

1.06 

40617 

-0.73 

52 

40 

0.37 

0.79 

-1.03 

0.76 

-0.51 

0.00 

0.54 

1.23 

40618 

0.45 

54 

28 

0.31 

0.97 

-0.23 

0.93 

-0.24 

0.00 

0.50 

1.09 

40619 

0.45 

52 

30 

0.32 

1.19 

1.41 

1.12 

0.65 

0.00 

0.34 

0.61 

40620 

0.49 

61 

38 

0.30 

0.97 

-0.18 

0.86 

-0.58 

0.00 

0.51 

1.10 

40621 

1.29 

66 

28 

0.28 

0.90 

-0.87 

0.80 

-1.15 

0.00 

0.55 

1.29 

40622 

1.34 

59 

24 

0.31 

0.96 

-0.28 

0.83 

-0.76 

0.00 

0.54 

1.15 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40623 

1.24 

59 

24 

0.30 

1.27 

2.15 

1.46 

2.38 

0.00 

0.21 

0.22 

40624 

-1.39 

56 

47 

0.39 

1.01 

0.10 

0.84 

-0.21 

0.00 

0.31 

1.02 

40625 

-0.84 

57 

44 

0.35 

0.86 

-0.76 

0.63 

-0.98 

0.00 

0.52 

1.24 

40626 

-0.85 

60 

46 

0.34 

0.97 

-0.08 

0.80 

-0.37 

0.00 

0.44 

1.07 

40627 

0.22 

55 

31 

0.31 

0.92 

-0.61 

0.93 

-0.26 

0.00 

0.52 

1.16 

40628 

0.37 

55 

32 

0.31 

0.76 

-2.11 

0.66 

-1.78 

0.00 

0.60 

1.64 

40629 

-0.28 

52 

36 

0.33 

1.04 

0.35 

0.94 

-0.10 

0.00 

0.38 

0.94 

40630 

-0.36 

54 

37 

0.32 

0.94 

-0.39 

0.84 

-0.64 

0.00 

0.48 

1.16 

40631 

0.59 

52 

27 

0.32 

0.83 

-1.39 

0.79 

-1.16 

0.00 

0.57 

1.46 

40632 

0.50 

56 

31 

0.31 

1.03 

0.26 

0.98 

-0.03 

0.00 

0.46 

0.95 

40633 

0.79 

50 

25 

0.32 

0.88 

-1.14 

0.79 

-0.92 

0.00 

0.52 

1.47 

40634 

0.26 

52 

34 

0.32 

0.85 

-1.23 

0.79 

-0.62 

0.00 

0.50 

1.39 

40635 

-0.17 

53 

33 

0.33 

0.90 

-0.72 

0.79 

-0.58 

-0.01 

0.54 

1.23 

40636 

1.11 

65 

28 

0.28 

0.88 

-1.08 

0.85 

-0.86 

0.00 

0.51 

1.31 

40637 

0.30 

53 

34 

0.31 

0.89 

-0.92 

0.80 

-0.73 

0.00 

0.47 

1.32 

40638 

0.64 

62 

30 

0.29 

1.13 

1.07 

1.14 

0.66 

0.00 

0.41 

0.70 

40639 

-2.28 

52 

46 

0.58 

1.02 

0.20 

1.79 

1.04 

0.00 

0.54 

0.90 

40640 

-2.34 

53 

49 

0.56 

0.90 

-0.14 

0.80 

-0.03 

-0.01 

0.35 

1.07 

40641 

-2.56 

51 

47 

0.55 

0.87 

-0.22 

0.38 

-0.75 

0.00 

0.36 

1.15 

40642 

-2.31 

59 

54 

0.51 

1.06 

0.29 

0.76 

-0.11 

0.00 

0.30 

0.99 

40643 

-2.24 

283 

271 

0.31 

0.85 

-0.52 

0.43 

-1.53 

0.00 

0.36 

1.10 

40644 

-1.57 

57 

49 

0.41 

0.88 

-0.44 

0.84 

-0.09 

-0.01 

0.37 

1.11 

40645 

-0.88 

54 

43 

0.37 

1.15 

0.77 

1.68 

1.49 

0.00 

0.23 

0.72 

40646 

-0.82 

54 

41 

0.36 

1.14 

0.79 

1.35 

0.98 

0.00 

0.31 

0.78 

40647 

1.49 

47 

19 

0.34 

0.80 

-1.42 

0.90 

-0.34 

0.00 

0.60 

1.37 

40648 

-1.41 

63 

54 

0.38 

0.87 

-0.49 

0.84 

-0.17 

0.00 

0.34 

1.11 

40649 

-1.10 

54 

43 

0.37 

0.87 

-0.60 

0.61 

-0.71 

0.00 

0.49 

1.21 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40650 

-1.58 

61 

54 

0.43 

1.02 

0.16 

0.80 

-0.15 

0.00 

0.29 

1.00 

40651 

4.47 

60 

3 

0.66 

0.92 

0.02 

1.33 

0.64 

0.00 

0.31 

0.99 

40652 

2.27 

60 

16 

0.34 

0.94 

-0.27 

1.30 

0.97 

0.00 

0.48 

1.00 

40653 

-1.94 

58 

51 

0.45 

0.80 

-0.55 

0.46 

-1.06 

0.00 

0.57 

1.18 

40654 

-2.77 

67 

63 

0.55 

0.74 

-0.56 

0.29 

-0.99 

0.00 

0.44 

1.18 

40655 

-1.86 

56 

50 

0.47 

0.80 

-0.53 

0.55 

-0.52 

0.00 

0.45 

1.16 

40656 

-2.30 

54 

49 

0.51 

0.89 

-0.21 

0.57 

-0.43 

0.00 

0.43 

1.09 

40657 

0.01 

62 

39 

0.30 

1.12 

0.95 

1.04 

0.26 

0.00 

0.37 

0.77 

40658 

-0.57 

55 

40 

0.32 

0.94 

-0.38 

0.87 

-0.55 

0.00 

0.41 

1.13 

40659 

0.12 

57 

33 

0.30 

1.08 

0.65 

1.19 

1.05 

0.00 

0.38 

0.75 

40660 

-0.76 

55 

43 

0.36 

0.98 

-0.06 

0.87 

-0.18 

0.00 

0.39 

1.05 

40661 

0.45 

58 

30 

0.29 

0.85 

-1.48 

0.77 

-1.15 

0.00 

0.54 

1.51 

40662 

1.92 

57 

14 

0.33 

0.92 

-0.44 

0.83 

-0.53 

0.00 

0.43 

1.14 

40663 

0.29 

250 

175 

0.15 

0.90 

-1.38 

0.76 

-2.10 

0.00 

0.49 

1.22 

40664 

1.12 

77 

36 

0.26 

0.93 

-0.68 

0.95 

-0.31 

0.00 

0.49 

1.18 

40665 

2.18 

66 

17 

0.33 

1.10 

0.64 

1.39 

1.01 

0.00 

0.41 

0.80 

40666 

-1.00 

57 

46 

0.36 

0.85 

-0.75 

0.67 

-0.94 

0.00 

0.49 

1.21 

40667 

0.91 

56 

25 

0.31 

0.95 

-0.34 

1.05 

0.31 

0.00 

0.50 

1.05 

40668 

1.92 

55 

15 

0.34 

1.06 

0.40 

1.43 

1.30 

0.00 

0.37 

0.81 

40669 

0.19 

68 

40 

0.27 

0.87 

-1.35 

0.81 

-1.07 

0.00 

0.51 

1.40 

40670 

-0.31 

52 

35 

0.33 

0.98 

-0.06 

0.84 

-0.59 

0.00 

0.47 

1.09 

40671 

0.25 

56 

35 

0.31 

1.03 

0.33 

0.89 

-0.39 

0.00 

0.40 

0.99 

40672 

0.88 

63 

30 

0.28 

0.96 

-0.42 

0.93 

-0.41 

0.00 

0.43 

1.16 

40673 

1.64 

65 

20 

0.31 

1.09 

0.67 

1.03 

0.19 

0.00 

0.41 

0.87 

40674 

1.48 

57 

20 

0.32 

1.06 

0.47 

1.43 

1.59 

0.00 

0.40 

0.80 

40675 

-0.33 

64 

47 

0.31 

1.03 

0.26 

1.00 

0.08 

0.00 

0.36 

0.96 

40676 

-0.35 

52 

40 

0.36 

0.81 

-1.06 

0.63 

-1.21 

0.00 

0.50 

1.32 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40677 

-0.04 

55 

36 

0.34 

0.85 

-0.95 

0.86 

-0.26 

0.00 

0.57 

1.22 

40678 

1.03 

65 

32 

0.28 

0.96 

-0.42 

1.08 

0.42 

0.00 

0.46 

1.07 

40679 

0.79 

57 

27 

0.31 

0.81 

-1.64 

0.76 

-1.36 

0.00 

0.57 

1.51 

40680 

1.52 

55 

22 

0.32 

0.87 

-1.01 

1.30 

1.23 

0.00 

0.54 

1.17 

40681 

1.06 

58 

21 

0.31 

0.89 

-0.80 

0.81 

-0.70 

0.00 

0.54 

1.24 

40682 

1.34 

54 

19 

0.32 

1.07 

0.56 

0.99 

0.05 

0.00 

0.39 

0.89 

40683 

2.05 

55 

17 

0.34 

0.95 

-0.26 

1.44 

1.39 

0.00 

0.46 

0.97 

40684 

-0.90 

51 

42 

0.40 

0.85 

-0.59 

0.69 

-0.65 

0.00 

0.50 

1.17 

40685 

-0.24 

63 

46 

0.31 

1.14 

0.95 

1.18 

0.63 

0.00 

0.27 

0.75 

40686 

-0.04 

55 

39 

0.34 

0.89 

-0.64 

1.05 

0.27 

0.00 

0.50 

1.10 

40687 

1.01 

53 

25 

0.31 

0.88 

-1.00 

0.84 

-0.94 

0.00 

0.52 

1.34 

40688 

1.05 

56 

24 

0.30 

1.02 

0.17 

1.24 

1.24 

0.00 

0.41 

0.87 

40689 

0.88 

55 

24 

0.30 

1.01 

0.14 

0.98 

-0.05 

0.00 

0.40 

0.99 

40690 

2.10 

82 

22 

0.27 

1.07 

0.50 

1.13 

0.69 

0.00 

0.33 

0.87 

40691 

-0.50 

55 

40 

0.33 

0.96 

-0.22 

1.07 

0.34 

0.00 

0.38 

1.03 

40692 

-0.39 

56 

37 

0.31 

0.96 

-0.22 

0.88 

-0.41 

0.00 

0.46 

1.10 

40693 

-1.25 

77 

64 

0.33 

1.03 

0.21 

0.88 

-0.22 

-0.01 

0.32 

1.00 

40694 

-0.01 

70 

45 

0.28 

0.76 

-2.17 

0.63 

-1.89 

0.00 

0.62 

1.54 

40695 

-0.43 

59 

42 

0.33 

0.99 

-0.02 

1.01 

0.13 

0.00 

0.46 

1.01 

40696 

0.28 

57 

32 

0.29 

0.97 

-0.26 

0.95 

-0.20 

0.00 

0.43 

1.10 

40697 

-1.47 

57 

49 

0.41 

0.95 

-0.11 

0.70 

-0.55 

0.00 

0.37 

1.08 

40698 

0.69 

56 

29 

0.30 

1.04 

0.38 

1.04 

0.24 

0.00 

0.42 

0.89 

40699 

-0.60 

56 

41 

0.35 

1.01 

0.09 

1.31 

0.90 

0.00 

0.46 

0.95 

40700 

1.31 

59 

24 

0.30 

0.91 

-0.74 

0.81 

-0.71 

0.00 

0.52 

1.26 

40701 

0.00 

54 

53 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40702 

-4.26 

56 

55 

1.06 

1.19 

0.50 

0.76 

0.28 

0.00 

0.12 

0.93 

40703 

-2.87 

55 

53 

0.73 

0.91 

0.07 

0.56 

-0.19 

0.00 

0.25 

1.06 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40704 

0.00 

56 

56 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40705 

0.00 

55 

54 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40706 

-2.65 

51 

48 

0.62 

1.01 

0.19 

0.54 

-0.29 

-0.01 

0.28 

1.04 

40707 

-3.79 

51 

50 

1.03 

1.10 

0.41 

1.14 

0.55 

0.00 

0.06 

0.93 

40708 

-3.85 

55 

54 

1.03 

1.05 

0.36 

0.60 

0.14 

0.00 

0.13 

0.99 

40709 

-3.45 

50 

49 

1.02 

1.07 

0.38 

1.89 

0.97 

0.00 

0.00 

0.90 

40710 

-0.40 

58 

44 

0.33 

1.05 

0.38 

1.08 

0.39 

0.00 

0.26 

0.90 

40711 

-1.96 

55 

49 

0.45 

0.92 

-0.15 

0.63 

-0.46 

0.00 

0.36 

1.09 

40712 

-2.82 

61 

58 

0.61 

0.99 

0.16 

0.49 

-0.43 

0.00 

0.26 

1.05 

40713 

-1.26 

50 

41 

0.40 

1.03 

0.19 

1.11 

0.38 

0.00 

0.32 

0.95 

40714 

-0.72 

50 

36 

0.36 

1.00 

0.05 

0.84 

-0.39 

0.00 

0.49 

1.04 

40715 

-0.60 

55 

38 

0.34 

0.96 

-0.19 

0.99 

0.09 

0.00 

0.51 

1.04 

40716 

-0.92 

57 

45 

0.35 

1.04 

0.27 

1.03 

0.21 

0.00 

0.33 

0.94 

40717 

-1.36 

55 

46 

0.42 

0.90 

-0.30 

1.34 

0.75 

0.00 

0.47 

1.03 

40718 

-0.69 

46 

38 

0.42 

0.93 

-0.21 

0.70 

-0.50 

0.00 

0.43 

1.11 

40719 

-0.85 

55 

42 

0.36 

1.00 

0.06 

1.08 

0.33 

0.00 

0.45 

0.98 

40720 

-0.91 

55 

43 

0.36 

1.32 

1.63 

2.06 

2.02 

0.00 

0.14 

0.43 

40721 

2.94 

58 

11 

0.37 

1.40 

1.81 

1.67 

1.44 

0.00 

0.06 

0.50 

40722 

-0.05 

61 

42 

0.31 

1.39 

2.51 

1.52 

1.79 

0.00 

0.18 

0.24 

40723 

-4.04 

56 

55 

1.04 

0.69 

-0.08 

0.08 

-0.74 

0.00 

0.46 

1.16 

40724 

-3.50 

49 

47 

1.02 

1.05 

0.36 

1.27 

0.65 

0.00 

0.42 

0.94 

40725 

0.00 

50 

50 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40726 

-2.24 

54 

49 

0.53 

1.32 

0.94 

6.51 

3.31 

-0.01 

0.10 

0.61 

40727 

0.00 

55 

55 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40728 

-4.18 

54 

53 

1.03 

1.08 

0.39 

1.09 

0.53 

0.00 

0.06 

0.94 

40729 

2.62 

53 

12 

0.36 

0.95 

-0.18 

0.98 

0.06 

0.00 

0.42 

1.04 

40730 

3.34 

51 

5 

0.50 

1.18 

0.60 

0.95 

0.20 

0.00 

0.18 

0.89 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40731 

0.99 

54 

27 

0.31 

1.32 

2.32 

1.46 

2.04 

0.00 

0.28 

0.19 

40732 

0.62 

55 

31 

0.31 

1.19 

1.54 

1.28 

1.44 

0.00 

0.29 

0.48 

40733 

0.06 

54 

35 

0.32 

1.08 

0.62 

1.20 

0.84 

0.00 

0.37 

0.77 

40734 

-0.89 

51 

40 

0.39 

1.41 

1.64 

1.43 

1.07 

0.00 

0.19 

0.57 

40735 

-0.41 

55 

40 

0.34 

1.30 

1.62 

1.32 

1.04 

0.00 

0.21 

0.57 

40736 

0.72 

55 

28 

0.31 

1.08 

0.85 

1.13 

0.72 

0.00 

0.40 

0.66 

40737 

-0.20 

55 

40 

0.32 

1.03 

0.23 

0.97 

-0.05 

0.00 

0.30 

0.97 

40738 

-0.77 

52 

41 

0.37 

0.80 

-1.05 

0.60 

-1.12 

0.00 

0.51 

1.30 

40739 

1.17 

51 

26 

0.32 

0.93 

-0.52 

0.83 

-0.81 

0.00 

0.54 

1.22 

40740 

0.94 

54 

25 

0.31 

1.01 

0.11 

0.93 

-0.31 

0.00 

0.45 

1.02 

40741 

-3.15 

47 

46 

1.02 

0.95 

0.25 

0.31 

-0.32 

0.00 

0.24 

1.07 

40742 

-1.83 

55 

50 

0.49 

1.06 

0.29 

0.67 

-0.28 

0.00 

0.28 

1.01 

40743 

-0.22 

55 

35 

0.32 

1.26 

1.70 

1.27 

0.94 

0.00 

0.33 

0.50 

40744 

-0.97 

55 

39 

0.35 

1.06 

0.40 

1.36 

1.09 

0.00 

0.44 

0.84 

40745 

-1.65 

46 

41 

0.50 

1.06 

0.29 

1.44 

0.79 

0.00 

0.18 

0.90 

40746 

0.00 

50 

50 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40747 

-3.48 

54 

52 

0.79 

0.55 

-0.75 

0.09 

-0.75 

-0.01 

0.48 

1.25 

40748 

-2.82 

55 

51 

0.57 

0.86 

-0.23 

0.42 

-0.63 

0.00 

0.38 

1.13 

40749 

-2.24 

54 

50 

0.54 

1.08 

0.33 

0.96 

0.21 

-0.01 

0.15 

0.95 

40750 

-2.80 

55 

51 

0.66 

0.95 

0.06 

0.45 

-0.36 

0.00 

0.57 

1.07 

40751 

2.69 

45 

11 

0.38 

1.25 

1.20 

1.72 

1.76 

0.00 

0.17 

0.60 

40752 

-0.14 

64 

44 

0.30 

1.09 

0.71 

1.02 

0.18 

0.00 

0.35 

0.85 

40753 

0.63 

55 

29 

0.32 

0.91 

-0.61 

0.89 

-0.40 

0.00 

0.55 

1.19 

40754 

4.06 

56 

5 

0.51 

1.07 

0.32 

0.86 

0.03 

0.00 

0.28 

0.97 

40755 

2.72 

56 

9 

0.38 

1.24 

1.04 

1.62 

1.34 

0.00 

0.02 

0.67 

40756 

2.44 

54 

9 

0.39 

1.04 

0.24 

1.27 

0.80 

0.00 

0.20 

0.90 

40757 

-0.93 

55 

45 

0.40 

0.92 

-0.25 

0.72 

-0.39 

0.00 

0.49 

1.10 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40758 

0.40 

58 

30 

0.30 

0.68 

-2.85 

0.58 

-1.92 

0.00 

0.67 

1.76 

40759 

0.17 

57 

30 

0.30 

0.95 

-0.41 

0.90 

-0.50 

0.00 

0.50 

1.16 

40760 

0.59 

55 

28 

0.31 

0.87 

-1.05 

0.77 

-1.22 

0.00 

0.56 

1.36 

40761 

0.02 

56 

33 

0.32 

0.91 

-0.59 

0.86 

-0.50 

0.00 

0.55 

1.18 

40762 

0.96 

57 

25 

0.30 

1.09 

0.71 

1.08 

0.48 

0.00 

0.41 

0.80 

40763 

0.45 

52 

30 

0.31 

0.80 

-1.68 

0.73 

-1.56 

0.00 

0.61 

1.53 

40764 

0.67 

53 

28 

0.32 

0.84 

-1.18 

0.74 

-1.25 

0.00 

0.59 

1.39 

40765 

-0.32 

55 

37 

0.32 

1.01 

0.13 

0.85 

-0.50 

0.00 

0.47 

1.04 

40766 

2.20 

58 

13 

0.34 

1.01 

0.10 

0.99 

0.08 

0.00 

0.31 

0.98 

40767 

-0.34 

64 

42 

0.30 

0.81 

-1.64 

0.64 

-1.47 

0.00 

0.60 

1.45 

40768 

-1.22 

61 

49 

0.36 

0.79 

-1.07 

0.57 

-1.22 

0.00 

0.57 

1.27 

40769 

-0.55 

68 

47 

0.30 

0.78 

-1.53 

0.64 

-1.42 

0.00 

0.62 

1.37 

40770 

-0.89 

59 

46 

0.35 

1.04 

0.27 

0.99 

0.10 

0.00 

0.39 

0.97 

40771 

-1.47 

56 

48 

0.40 

0.95 

-0.10 

0.90 

-0.02 

0.00 

0.31 

1.04 

40772 

2.24 

50 

14 

0.35 

0.92 

-0.39 

0.86 

-0.39 

0.00 

0.50 

1.13 

40773 

-0.77 

57 

47 

0.39 

0.68 

-1.48 

0.42 

-1.43 

0.00 

0.63 

1.35 

40774 

-1.08 

61 

48 

0.34 

0.91 

-0.46 

0.66 

-0.85 

-0.01 

0.47 

1.18 

40775 

0.50 

59 

33 

0.30 

0.77 

-2.16 

0.65 

-1.91 

0.00 

0.64 

1.62 

40776 

1.59 

257 

118 

0.14 

0.84 

-3.25 

0.76 

-3.00 

0.00 

0.55 

1.49 

40777 

0.36 

59 

32 

0.30 

0.83 

-1.39 

0.96 

-0.11 

0.00 

0.55 

1.34 

40778 

1.29 

54 

21 

0.32 

0.84 

-1.23 

0.75 

-1.14 

0.00 

0.58 

1.37 

40779 

1.09 

55 

23 

0.31 

0.98 

-0.13 

0.94 

-0.29 

0.00 

0.45 

1.08 

40780 

0.75 

55 

27 

0.30 

0.98 

-0.17 

0.98 

-0.03 

0.00 

0.46 

1.05 

40781 

-0.97 

55 

46 

0.39 

0.96 

-0.08 

0.89 

-0.15 

0.00 

0.34 

1.05 

40782 

1.03 

56 

24 

0.30 

0.81 

-1.70 

0.74 

-1.58 

0.00 

0.56 

1.53 

40783 

1.03 

60 

25 

0.29 

1.15 

1.24 

1.13 

0.69 

0.00 

0.34 

0.65 

40784 

0.53 

286 

189 

0.14 

0.87 

-2.33 

0.82 

-1.93 

0.00 

0.51 

1.30 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40785 

0.83 

55 

28 

0.31 

0.73 

-2.44 

0.64 

-1.92 

0.00 

0.66 

1.71 

40786 

1.21 

66 

24 

0.29 

1.06 

0.48 

1.02 

0.17 

0.00 

0.43 

0.90 

40787 

-1.31 

54 

46 

0.40 

0.83 

-0.63 

0.67 

-0.59 

0.00 

0.41 

1.18 

40788 

-0.41 

51 

36 

0.35 

0.89 

-0.73 

0.82 

-0.50 

-0.01 

0.48 

1.22 

40789 

0.05 

51 

32 

0.32 

1.02 

0.19 

0.97 

-0.06 

0.00 

0.42 

0.98 

40790 

-0.85 

71 

56 

0.33 

1.01 

0.12 

1.34 

0.91 

0.00 

0.39 

0.93 

40791 

-0.33 

55 

42 

0.35 

0.92 

-0.36 

0.73 

-0.81 

0.00 

0.50 

1.15 

40792 

-0.18 

54 

34 

0.32 

0.90 

-0.82 

0.90 

-0.26 

0.00 

0.48 

1.24 

40793 

-1.11 

63 

51 

0.37 

1.00 

0.08 

1.03 

0.21 

0.00 

0.47 

0.99 

40794 

-0.52 

53 

41 

0.35 

1.04 

0.26 

1.07 

0.35 

0.00 

0.30 

0.94 

40795 

-0.50 

50 

38 

0.36 

0.76 

-1.36 

0.57 

-0.97 

0.00 

0.56 

1.38 

40796 

-1.49 

54 

46 

0.44 

1.30 

1.06 

1.90 

1.32 

0.00 

0.26 

0.69 

40797 

-0.67 

55 

43 

0.35 

1.16 

0.86 

1.26 

0.86 

0.00 

0.20 

0.78 

40798 

-0.79 

57 

45 

0.36 

0.87 

-0.66 

0.64 

-1.01 

0.00 

0.52 

1.21 

40799 

-1.65 

59 

50 

0.38 

0.97 

-0.05 

0.95 

0.01 

0.00 

0.34 

1.03 

40800 

-0.82 

48 

39 

0.42 

0.95 

-0.12 

0.68 

-0.65 

0.00 

0.52 

1.10 

40801 

1.27 

56 

22 

0.32 

1.12 

0.82 

1.29 

1.07 

0.00 

0.43 

0.71 

40802 

0.82 

56 

29 

0.30 

1.06 

0.59 

1.04 

0.32 

0.00 

0.39 

0.83 

40803 

0.14 

55 

36 

0.31 

0.95 

-0.39 

0.86 

-0.54 

0.00 

0.46 

1.16 

40804 

1.07 

54 

24 

0.32 

0.92 

-0.63 

0.97 

-0.06 

0.00 

0.53 

1.15 

40805 

1.27 

58 

24 

0.31 

0.95 

-0.33 

0.88 

-0.47 

0.00 

0.55 

1.12 

40806 

0.54 

50 

32 

0.33 

1.02 

0.19 

1.26 

1.05 

0.00 

0.38 

0.85 

40807 

0.62 

57 

28 

0.30 

0.92 

-0.74 

0.90 

-0.48 

0.00 

0.50 

1.23 

40808 

-0.28 

56 

39 

0.32 

0.98 

-0.10 

0.89 

-0.36 

0.00 

0.43 

1.06 

40809 

0.49 

51 

30 

0.32 

0.92 

-0.68 

0.82 

-0.90 

0.00 

0.49 

1.29 

40810 

0.72 

62 

30 

0.29 

1.02 

0.18 

1.10 

0.59 

0.00 

0.43 

0.91 

40811 

2.86 

54 

8 

0.41 

0.92 

-0.25 

0.87 

-0.11 

0.00 

0.37 

1.07 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40812 

2.06 

54 

15 

0.35 

0.96 

-0.16 

1.33 

0.97 

0.00 

0.47 

0.99 

40813 

1.65 

55 

16 

0.34 

1.02 

0.15 

1.27 

0.81 

0.00 

0.44 

0.91 

40814 

2.18 

264 

76 

0.15 

1.00 

0.03 

0.97 

-0.24 

0.00 

0.39 

1.01 

40815 

1.86 

50 

16 

0.35 

0.99 

-0.03 

1.22 

0.82 

0.00 

0.43 

0.92 

40816 

0.86 

55 

25 

0.31 

1.21 

1.55 

1.21 

1.04 

0.00 

0.36 

0.54 

40817 

2.87 

52 

8 

0.41 

0.87 

-0.44 

1.12 

0.40 

0.00 

0.32 

1.06 

40818 

1.55 

52 

19 

0.34 

0.94 

-0.38 

1.09 

0.42 

0.00 

0.47 

1.05 

40819 

2.58 

53 

7 

0.43 

1.10 

0.45 

3.10 

2.89 

0.00 

0.05 

0.78 

40820 

-0.63 

58 

42 

0.33 

1.29 

1.68 

1.53 

1.60 

0.00 

0.23 

0.50 

40821 

1.83 

56 

15 

0.33 

1.40 

2.44 

2.44 

3.44 

0.00 

0.01 

0.03 

40822 

1.70 

55 

16 

0.34 

1.44 

2.44 

2.11 

2.15 

0.00 

0.14 

0.12 

40823 

1.70 

58 

17 

0.32 

0.92 

-0.52 

0.79 

-0.77 

0.00 

0.50 

1.18 

40824 

-0.13 

256 

200 

0.16 

1.09 

1.04 

1.15 

0.95 

0.00 

0.25 

0.86 

40825 

0.24 

53 

35 

0.32 

1.00 

0.02 

1.01 

0.12 

0.00 

0.40 

1.00 

40826 

-0.52 

60 

42 

0.33 

1.19 

1.16 

1.31 

0.86 

0.00 

0.38 

0.66 

40827 

0.90 

56 

25 

0.30 

1.11 

0.87 

1.63 

2.84 

0.00 

0.33 

0.58 

40828 

-1.55 

58 

49 

0.43 

1.27 

1.05 

2.69 

2.24 

0.00 

0.28 

0.62 

40829 

-1.05 

58 

46 

0.34 

0.96 

-0.17 

1.04 

0.23 

0.00 

0.32 

1.03 

40830 

-0.54 

50 

38 

0.38 

1.22 

1.13 

1.84 

1.84 

0.00 

0.27 

0.57 

40831 

0.16 

57 

28 

0.31 

0.83 

-1.29 

0.69 

-1.28 

0.00 

0.63 

1.39 

40832 

-0.22 

48 

34 

0.36 

1.09 

0.56 

1.05 

0.25 

0.00 

0.41 

0.86 

40833 

-2.30 

59 

54 

0.50 

0.92 

-0.11 

0.62 

-0.34 

0.00 

0.37 

1.07 

40834 

-0.76 

54 

40 

0.34 

0.89 

-0.62 

0.73 

-0.74 

0.00 

0.49 

1.21 

40835 

-0.81 

55 

43 

0.36 

0.86 

-0.71 

0.62 

-1.00 

0.00 

0.52 

1.24 

40836 

-0.21 

55 

36 

0.33 

0.90 

-0.69 

0.76 

-0.80 

0.00 

0.56 

1.24 

40837 

-1.23 

58 

48 

0.39 

0.72 

-1.32 

0.53 

-1.05 

-0.01 

0.54 

1.31 

40838 

0.66 

57 

34 

0.30 

0.93 

-0.62 

0.93 

-0.29 

0.00 

0.46 

1.19 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40839 

1.20 

55 

22 

0.31 

0.84 

-1.30 

0.74 

-1.41 

0.00 

0.60 

1.42 

40840 

0.82 

57 

27 

0.30 

1.12 

1.03 

1.08 

0.51 

0.00 

0.37 

0.72 

40841 

-0.79 

54 

42 

0.36 

0.78 

-1.24 

0.58 

-1.09 

0.00 

0.54 

1.34 

40842 

-1.64 

59 

51 

0.40 

0.94 

-0.15 

1.18 

0.53 

-0.01 

0.30 

1.00 

40843 

-1.50 

59 

53 

0.46 

0.90 

-0.22 

0.84 

-0.08 

-0.01 

0.34 

1.08 

40844 

-0.03 

54 

33 

0.31 

0.91 

-0.69 

0.86 

-0.75 

0.00 

0.48 

1.26 

40845 

-0.73 

61 

48 

0.35 

1.00 

0.07 

0.97 

0.05 

0.00 

0.40 

1.00 

40846 

-1.73 

55 

48 

0.43 

0.95 

-0.10 

0.74 

-0.38 

0.00 

0.37 

1.06 

40847 

-1.48 

58 

51 

0.45 

0.88 

-0.27 

0.61 

-0.60 

0.00 

0.50 

1.11 

40848 

-1.56 

54 

47 

0.43 

1.00 

0.10 

0.87 

0.01 

0.00 

0.31 

1.00 

40849 

-0.58 

48 

36 

0.38 

0.99 

0.03 

0.78 

-0.24 

0.00 

0.46 

1.06 

40850 

-2.04 

57 

51 

0.49 

1.05 

0.25 

0.63 

-0.43 

0.00 

0.43 

1.03 

40851 

-0.47 

55 

40 

0.33 

0.86 

-1.00 

0.78 

-0.66 

-0.01 

0.44 

1.29 

40852 

-0.17 

61 

40 

0.30 

0.96 

-0.25 

1.05 

0.30 

0.00 

0.47 

1.04 

40853 

1.59 

55 

15 

0.35 

1.02 

0.18 

1.08 

0.36 

0.00 

0.46 

0.95 

40854 

-0.09 

53 

30 

0.30 

0.98 

-0.18 

0.98 

-0.05 

0.00 

0.40 

1.07 

40855 

0.59 

59 

33 

0.30 

0.99 

-0.04 

0.89 

-0.44 

0.00 

0.48 

1.07 

40856 

1.44 

57 

20 

0.30 

1.30 

2.32 

1.66 

3.02 

0.00 

0.02 

0.10 

40857 

1.45 

61 

21 

0.31 

1.36 

2.25 

1.89 

2.95 

0.00 

0.22 

0.30 

40858 

2.99 

51 

9 

0.40 

0.93 

-0.23 

0.96 

0.06 

0.00 

0.44 

1.06 

40859 

0.94 

57 

28 

0.30 

0.95 

-0.37 

0.87 

-0.64 

0.00 

0.49 

1.17 

40860 

-0.97 

55 

43 

0.37 

1.17 

0.90 

2.92 

2.96 

0.00 

0.24 

0.63 

40861 

0.83 

54 

29 

0.33 

0.88 

-0.81 

0.81 

-0.84 

0.00 

0.61 

1.26 

40862 

-1.14 

51 

41 

0.39 

0.74 

-1.23 

0.54 

-1.19 

0.00 

0.57 

1.31 

40863 

-1.35 

49 

40 

0.42 

1.20 

0.87 

1.51 

1.01 

0.00 

0.30 

0.75 

40864 

-0.36 

54 

38 

0.33 

1.01 

0.13 

0.91 

-0.32 

0.00 

0.38 

1.02 

40865 

-0.21 

54 

38 

0.34 

1.11 

0.70 

0.99 

0.07 

0.00 

0.39 

0.86 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40866 

0.01 

59 

38 

0.29 

0.90 

-0.87 

0.79 

-1.24 

0.00 

0.50 

1.32 

40867 

1.09 

57 

23 

0.30 

0.87 

-1.03 

0.83 

-0.87 

0.00 

0.50 

1.32 

40868 

-2.93 

49 

47 

0.74 

0.87 

-0.01 

0.33 

-0.38 

0.00 

0.32 

1.10 

40869 

1.52 

57 

20 

0.33 

1.33 

1.88 

1.81 

2.65 

0.00 

0.30 

0.35 

40870 

-3.43 

58 

57 

1.02 

1.05 

0.36 

1.77 

0.92 

0.00 

-0.01 

0.93 

40871 

-0.70 

46 

38 

0.43 

0.85 

-0.52 

0.81 

-0.21 

0.00 

0.47 

1.13 

40872 

-2.27 

47 

44 

0.62 

0.93 

0.01 

0.51 

-0.26 

0.00 

0.29 

1.08 

40873 

-1.71 

44 

40 

0.55 

1.09 

0.35 

1.21 

0.51 

0.00 

0.15 

0.91 

40874 

-0.09 

57 

37 

0.31 

1.01 

0.12 

0.97 

-0.02 

0.00 

0.41 

0.98 

40875 

-1.62 

56 

47 

0.43 

0.83 

-0.59 

0.57 

-0.37 

0.00 

0.55 

1.18 

40876 

-2.42 

51 

48 

0.61 

1.01 

0.19 

0.87 

0.16 

0.00 

0.18 

1.00 

40877 

0.00 

58 

58 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

40878 

-0.68 

54 

40 

0.36 

0.90 

-0.46 

0.68 

-0.73 

0.00 

0.57 

1.17 

40879 

-0.17 

56 

37 

0.32 

0.97 

-0.18 

1.01 

0.13 

0.00 

0.46 

1.04 

40880 

-0.72 

55 

42 

0.35 

1.03 

0.21 

0.98 

0.07 

0.00 

0.35 

0.96 

40881 

-0.28 

62 

41 

0.32 

0.92 

-0.54 

0.80 

-0.55 

0.00 

0.57 

1.16 

40882 

0.63 

52 

28 

0.31 

0.95 

-0.40 

0.92 

-0.31 

0.00 

0.49 

1.15 

40883 

1.72 

56 

19 

0.31 

0.98 

-0.13 

0.88 

-0.44 

0.00 

0.43 

1.09 

40884 

0.26 

43 

26 

0.35 

1.05 

0.37 

0.99 

0.05 

0.00 

0.43 

0.91 

40885 

1.27 

53 

21 

0.33 

0.92 

-0.48 

0.94 

-0.07 

0.00 

0.51 

1.13 

40886 

0.12 

55 

35 

0.31 

0.87 

-1.02 

0.77 

-1.09 

0.00 

0.54 

1.34 

40887 

-2.78 

58 

56 

0.74 

1.10 

0.36 

0.78 

0.14 

-0.01 

0.14 

0.96 

40888 

-1.13 

54 

41 

0.36 

1.07 

0.44 

1.46 

1.23 

0.00 

0.35 

0.82 

40889 

-1.34 

60 

49 

0.36 

0.97 

-0.06 

0.85 

-0.15 

-0.01 

0.38 

1.04 

40890 

-0.55 

55 

42 

0.35 

0.90 

-0.50 

0.76 

-0.75 

0.00 

0.50 

1.16 

40891 

-0.97 

55 

43 

0.39 

0.86 

-0.59 

0.67 

-0.73 

0.00 

0.59 

1.17 

40892 

1.47 

54 

19 

0.32 

1.14 

1.04 

1.30 

1.32 

0.00 

0.28 

0.62 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40893 

-3.49 

49 

48 

1.02 

1.01 

0.32 

0.48 

0.01 

0.00 

0.16 

1.02 

40894 

-1.49 

61 

50 

0.38 

0.93 

-0.21 

0.77 

-0.30 

0.00 

0.47 

1.08 

40895 

-2.78 

55 

50 

0.55 

0.88 

-0.18 

0.45 

-0.47 

0.00 

0.52 

1.12 

40896 

-1.06 

52 

44 

0.41 

0.83 

-0.65 

0.78 

-0.27 

0.00 

0.45 

1.16 

40897 

-0.61 

53 

40 

0.34 

1.20 

1.16 

1.19 

0.59 

0.00 

0.19 

0.67 

40898 

-1.61 

51 

44 

0.44 

0.89 

-0.32 

0.64 

-0.56 

0.00 

0.46 

1.13 

40899 

-1.43 

55 

46 

0.42 

1.08 

0.43 

0.83 

-0.03 

-0.01 

0.41 

0.94 

40900 

-2.02 

50 

46 

0.54 

0.87 

-0.20 

0.42 

-0.82 

-0.01 

0.39 

1.14 

40901 

1.78 

53 

17 

0.33 

1.17 

1.12 

1.17 

0.77 

0.00 

0.29 

0.69 

40902 

2.41 

56 

13 

0.36 

1.40 

1.93 

1.85 

1.95 

0.00 

0.13 

0.41 

40903 

-2.20 

54 

49 

0.56 

0.87 

-0.16 

0.55 

-0.51 

0.00 

0.53 

1.09 

40904 

-1.48 

57 

50 

0.43 

0.93 

-0.15 

0.66 

-0.41 

0.00 

0.36 

1.09 

40905 

-0.97 

55 

44 

0.37 

0.75 

-1.34 

0.51 

-1.38 

0.00 

0.61 

1.34 

40906 

-0.98 

55 

42 

0.35 

0.89 

-0.58 

0.74 

-0.67 

0.00 

0.51 

1.18 

40907 

2.01 

53 

16 

0.34 

1.41 

2.20 

1.64 

2.16 

0.00 

0.13 

0.31 

40908 

-0.55 

55 

36 

0.33 

1.38 

2.44 

1.38 

1.20 

0.00 

0.29 

0.25 

40909 

0.97 

55 

24 

0.31 

1.19 

1.42 

1.49 

2.16 

0.00 

0.31 

0.47 

40910 

0.17 

56 

34 

0.31 

1.08 

0.63 

1.29 

1.41 

0.00 

0.36 

0.76 

40911 

2.02 

61 

16 

0.32 

1.13 

0.83 

1.65 

2.00 

0.00 

0.26 

0.70 

40912 

-1.52 

261 

239 

0.23 

0.86 

-0.77 

0.69 

-0.98 

0.00 

0.38 

1.10 

40913 

-0.45 

47 

37 

0.38 

0.83 

-0.82 

0.61 

-0.98 

0.00 

0.51 

1.27 

40914 

-1.54 

54 

49 

0.50 

0.79 

-0.52 

0.89 

0.09 

-0.01 

0.41 

1.12 

40915 

-1.45 

58 

49 

0.39 

0.79 

-0.87 

0.57 

-1.08 

0.00 

0.47 

1.23 

40916 

-1.65 

55 

46 

0.41 

0.82 

-0.66 

0.68 

-0.63 

0.00 

0.52 

1.16 

40917 

1.83 

62 

20 

0.30 

1.07 

0.52 

1.07 

0.38 

0.00 

0.37 

0.87 

40918 

1.30 

48 

20 

0.33 

1.18 

1.37 

1.30 

1.43 

0.00 

0.28 

0.48 

40919 

-2.97 

54 

52 

0.73 

0.97 

0.17 

0.63 

-0.13 

0.00 

0.23 

1.03 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40920 

-2.64 

57 

53 

0.61 

0.97 

0.10 

1.16 

0.46 

0.00 

0.39 

0.99 

40921 

-1.65 

53 

46 

0.43 

0.92 

-0.19 

0.74 

-0.33 

0.00 

0.36 

1.08 

40922 

-1.28 

54 

45 

0.40 

0.89 

-0.44 

0.80 

-0.25 

0.00 

0.44 

1.11 

40923 

-1.05 

54 

44 

0.39 

0.79 

-0.88 

0.63 

-0.94 

0.00 

0.55 

1.23 

40924 

-0.78 

54 

43 

0.39 

0.89 

-0.44 

0.62 

-0.76 

0.00 

0.54 

1.17 

40925 

-0.56 

56 

43 

0.35 

1.15 

0.86 

1.28 

0.93 

0.00 

0.27 

0.77 

40926 

-0.27 

266 

211 

0.17 

0.92 

-0.81 

0.88 

-0.67 

0.00 

0.45 

1.09 

40927 

0.00 

48 

30 

0.34 

0.90 

-0.74 

0.82 

-0.68 

0.00 

0.50 

1.28 

40928 

1.49 

54 

19 

0.32 

1.37 

2.49 

1.84 

3.05 

0.00 

0.09 

0.07 

40929 

2.42 

58 

11 

0.37 

1.30 

1.34 

1.66 

1.40 

0.00 

0.15 

0.63 

40930 

0.28 

47 

26 

0.34 

1.01 

0.10 

1.06 

0.35 

0.00 

0.45 

0.94 

40931 

2.45 

50 

12 

0.38 

0.94 

-0.24 

1.41 

1.00 

0.00 

0.46 

0.99 

40932 

1.79 

55 

14 

0.34 

1.12 

0.71 

1.49 

1.54 

0.00 

0.27 

0.74 

40933 

-2.52 

243 

235 

0.38 

0.82 

-0.48 

0.37 

-1.40 

0.00 

0.36 

1.10 

40934 

0.53 

58 

31 

0.31 

1.27 

2.06 

1.64 

2.76 

0.00 

0.30 

0.22 

40935 

-0.31 

64 

45 

0.32 

0.86 

-0.95 

0.82 

-0.61 

0.00 

0.57 

1.22 

40936 

-0.65 

52 

39 

0.36 

1.10 

0.59 

1.00 

0.11 

0.00 

0.37 

0.90 

40937 

0.95 

50 

23 

0.32 

0.93 

-0.51 

0.90 

-0.26 

0.00 

0.48 

1.18 

40938 

0.37 

287 

202 

0.14 

0.90 

-1.64 

0.84 

-1.21 

0.00 

0.49 

1.19 

40939 

1.02 

52 

24 

0.32 

0.92 

-0.57 

0.99 

0.02 

0.00 

0.52 

1.13 

40940 

0.45 

57 

28 

0.29 

1.05 

0.50 

1.05 

0.41 

0.00 

0.35 

0.83 

40941 

-1.78 

55 

48 

0.44 

1.19 

0.69 

1.06 

0.28 

0.00 

0.22 

0.88 

40942 

1.79 

49 

16 

0.35 

0.84 

-0.99 

0.71 

-1.01 

0.00 

0.58 

1.33 

40943 

0.09 

58 

37 

0.31 

0.86 

-1.11 

0.76 

-1.07 

0.00 

0.57 

1.34 

40944 

2.86 

50 

9 

0.41 

1.50 

1.90 

2.05 

1.68 

0.00 

0.06 

0.41 

40945 

-0.37 

51 

35 

0.34 

0.87 

-0.81 

0.70 

-0.90 

0.00 

0.57 

1.27 

40946 

1.50 

62 

23 

0.29 

0.97 

-0.20 

0.96 

-0.13 

0.00 

0.45 

1.07 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40947 

0.77 

56 

25 

0.31 

1.09 

0.74 

1.14 

0.71 

0.00 

0.40 

0.75 

40948 

1.97 

55 

13 

0.35 

0.89 

-0.55 

2.04 

2.39 

0.00 

0.38 

0.96 

40949 

-0.02 

56 

36 

0.31 

0.99 

-0.04 

0.89 

-0.44 

0.00 

0.47 

1.06 

40950 

1.36 

54 

19 

0.34 

1.16 

0.96 

1.25 

0.91 

0.00 

0.44 

0.71 

40951 

-2.10 

56 

52 

0.55 

0.88 

-0.20 

1.68 

0.93 

0.00 

0.28 

1.03 

40952 

-1.16 

61 

50 

0.36 

0.83 

-0.79 

1.06 

0.27 

0.00 

0.42 

1.13 

40953 

0.66 

62 

36 

0.29 

1.00 

0.07 

1.30 

1.18 

0.00 

0.44 

0.89 

40954 

1.32 

55 

21 

0.30 

1.02 

0.24 

1.00 

0.05 

0.00 

0.38 

0.94 

40955 

-0.24 

56 

42 

0.34 

0.92 

-0.48 

0.73 

-0.64 

-0.01 

0.46 

1.18 

40956 

-0.24 

51 

34 

0.35 

0.87 

-0.78 

0.97 

0.04 

0.00 

0.54 

1.19 

40957 

-1.39 

52 

45 

0.43 

0.82 

-0.57 

0.78 

-0.37 

0.00 

0.48 

1.15 

40958 

0.77 

252 

158 

0.14 

0.94 

-1.14 

0.90 

-1.00 

0.00 

0.47 

1.16 

40959 

0.40 

74 

43 

0.26 

1.12 

1.34 

1.43 

2.18 

-0.01 

0.32 

0.48 

40960 

1.74 

54 

18 

0.32 

0.89 

-0.82 

0.74 

-0.81 

0.00 

0.45 

1.32 

40961 

-2.41 

56 

51 

0.57 

1.44 

1.01 

1.32 

0.63 

0.00 

0.31 

0.77 

40962 

-0.79 

55 

42 

0.34 

1.03 

0.25 

0.92 

-0.14 

0.00 

0.33 

0.98 

40963 

-0.78 

59 

45 

0.33 

0.95 

-0.23 

0.82 

-0.39 

0.00 

0.42 

1.09 

40964 

-0.78 

50 

38 

0.37 

0.98 

-0.01 

0.78 

-0.28 

0.00 

0.44 

1.07 

40965 

-0.31 

54 

38 

0.34 

0.90 

-0.64 

0.95 

0.00 

0.00 

0.49 

1.13 

40966 

-0.42 

50 

36 

0.37 

1.17 

0.92 

1.23 

0.65 

0.00 

0.39 

0.74 

40967 

1.69 

55 

19 

0.33 

0.86 

-0.87 

1.15 

0.64 

0.00 

0.57 

1.15 

40968 

1.63 

55 

19 

0.32 

1.14 

1.02 

1.25 

1.09 

0.00 

0.32 

0.67 

40969 

2.10 

57 

17 

0.33 

1.14 

0.91 

1.30 

1.15 

0.00 

0.32 

0.72 

40970 

2.22 

55 

11 

0.38 

1.00 

0.05 

1.11 

0.40 

0.00 

0.42 

0.98 

40971 

0.02 

60 

41 

0.31 

1.21 

1.56 

1.30 

1.17 

0.00 

0.25 

0.52 

40972 

0.31 

51 

31 

0.33 

1.18 

1.46 

1.67 

1.98 

0.00 

0.32 

0.41 

40973 

0.99 

50 

22 

0.32 

0.98 

-0.15 

2.35 

4.17 

0.00 

0.38 

0.76 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40974 

1.64 

52 

19 

0.34 

1.38 

2.27 

2.11 

3.38 

0.00 

0.27 

0.15 

40975 

2.31 

56 

14 

0.34 

1.19 

1.05 

1.85 

2.47 

0.00 

0.19 

0.61 

40976 

1.81 

54 

16 

0.34 

0.90 

-0.59 

0.85 

-0.47 

0.00 

0.53 

1.16 

40977 

0.73 

47 

23 

0.33 

1.22 

1.61 

1.23 

1.04 

0.00 

0.30 

0.41 

40978 

1.17 

49 

20 

0.32 

1.16 

1.37 

1.25 

1.15 

0.00 

0.29 

0.42 

40979 

1.07 

51 

25 

0.33 

1.33 

2.26 

1.97 

2.26 

0.00 

0.32 

0.13 

40980 

1.35 

57 

23 

0.31 

1.04 

0.36 

1.07 

0.32 

0.00 

0.42 

0.88 

40981 

1.12 

55 

21 

0.31 

1.04 

0.40 

1.00 

0.08 

0.00 

0.40 

0.92 

40982 

1.06 

58 

23 

0.29 

0.99 

-0.01 

0.94 

-0.35 

0.00 

0.41 

1.05 

40983 

0.44 

245 

160 

0.15 

0.97 

-0.46 

0.94 

-0.50 

0.00 

0.42 

1.07 

40984 

1.49 

56 

18 

0.32 

0.94 

-0.33 

0.92 

-0.24 

0.00 

0.48 

1.09 

40985 

1.60 

49 

17 

0.34 

1.01 

0.11 

0.89 

-0.36 

0.00 

0.45 

1.03 

40986 

1.32 

55 

21 

0.31 

1.07 

0.52 

1.24 

1.13 

0.00 

0.39 

0.81 

40987 

1.82 

48 

16 

0.38 

0.81 

-1.01 

0.72 

-0.70 

0.00 

0.62 

1.28 

40988 

-1.93 

61 

53 

0.45 

1.11 

0.43 

0.70 

-0.39 

0.00 

0.50 

0.99 

40989 

-1.55 

243 

222 

0.24 

0.98 

-0.06 

0.83 

-0.40 

0.00 

0.34 

1.04 

40990 

-0.92 

56 

43 

0.36 

1.00 

0.07 

0.87 

-0.12 

-0.01 

0.45 

1.02 

40991 

-1.55 

56 

49 

0.42 

0.97 

-0.03 

0.65 

-0.60 

0.00 

0.36 

1.07 

40992 

-0.33 

55 

38 

0.33 

0.82 

-1.20 

0.69 

-1.05 

0.00 

0.55 

1.35 

40993 

0.02 

68 

45 

0.28 

1.08 

0.74 

1.02 

0.16 

0.00 

0.34 

0.83 

40994 

0.00 

58 

39 

0.31 

0.84 

-1.28 

0.67 

-1.28 

-0.01 

0.54 

1.41 

40995 

0.08 

48 

31 

0.33 

0.92 

-0.60 

0.84 

-0.74 

0.00 

0.46 

1.24 

40996 

0.56 

56 

30 

0.30 

0.78 

-2.11 

0.68 

-1.82 

0.00 

0.62 

1.66 

40997 

1.27 

56 

20 

0.32 

0.98 

-0.08 

1.06 

0.33 

0.00 

0.49 

1.00 

40998 

0.54 

56 

30 

0.30 

0.86 

-1.29 

0.76 

-0.63 

0.00 

0.54 

1.43 

40999 

-0.03 

55 

38 

0.33 

1.01 

0.10 

0.89 

-0.31 

0.00 

0.43 

1.03 

41000 

-0.39 

47 

34 

0.36 

0.97 

-0.11 

0.89 

-0.09 

0.00 

0.43 

1.06 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

41001 

0.31 

59 

33 

0.29 

0.96 

-0.30 

0.93 

-0.33 

0.00 

0.43 

1.12 

41002 

0.79 

56 

30 

0.31 

1.21 

1.62 

1.24 

1.25 

0.00 

0.32 

0.46 

41003 

0.85 

51 

25 

0.33 

1.30 

2.09 

1.41 

1.21 

0.00 

0.36 

0.26 

41004 

0.63 

55 

26 

0.32 

1.15 

1.20 

1.20 

0.64 

0.00 

0.41 

0.59 

41005 

0.87 

54 

25 

0.30 

1.12 

1.15 

1.12 

0.72 

0.00 

0.30 

0.60 

41006 

0.89 

61 

30 

0.29 

1.15 

1.34 

1.20 

1.17 

0.00 

0.33 

0.56 

41007 

1.01 

61 

27 

0.30 

0.95 

-0.41 

0.92 

-0.22 

0.00 

0.51 

1.12 

41008 

0.56 

55 

30 

0.31 

1.28 

2.15 

1.29 

1.62 

0.00 

0.26 

0.30 

41009 

1.03 

55 

26 

0.32 

1.11 

0.86 

1.14 

0.71 

0.00 

0.43 

0.75 

41010 

0.00 

67 

67 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

41011 

-2.95 

57 

54 

0.63 

0.87 

-0.11 

0.52 

-0.25 

0.00 

0.36 

1.08 

41012 

0.00 

62 

62 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

41013 

0.00 

56 

56 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

41014 

-2.49 

53 

48 

0.54 

1.26 

0.73 

2.10 

1.29 

0.00 

0.25 

0.80 

41015 

0.00 

55 

55 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

41016 

0.00 

68 

68 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

41017 

-2.40 

71 

66 

0.48 

1.16 

0.54 

2.03 

1.33 

0.00 

0.08 

0.86 

41018 

-2.27 

53 

48 

0.53 

0.72 

-0.68 

0.33 

-0.95 

0.00 

0.51 

1.22 

41019 

-1.57 

54 

47 

0.44 

0.90 

-0.24 

0.70 

-0.33 

0.00 

0.40 

1.09 

41020 

-1.63 

70 

61 

0.38 

0.95 

-0.13 

0.65 

-0.58 

0.00 

0.36 

1.09 

41021 

-1.43 

51 

44 

0.43 

1.14 

0.58 

2.46 

2.03 

0.00 

0.11 

0.76 

41022 

-1.37 

52 

44 

0.42 

0.86 

-0.47 

0.66 

-0.35 

0.00 

0.42 

1.15 

41023 

-2.00 

55 

49 

0.50 

1.04 

0.22 

0.61 

-0.35 

-0.01 

0.48 

1.03 

41024 

-0.73 

56 

45 

0.36 

1.14 

0.73 

1.71 

1.72 

0.00 

0.17 

0.74 

41025 

-1.41 

50 

41 

0.42 

0.78 

-0.84 

0.52 

-1.02 

0.00 

0.57 

1.25 

41026 

-1.33 

60 

51 

0.41 

1.11 

0.51 

1.17 

0.47 

-0.01 

0.33 

0.87 

41027 

1.11 

55 

21 

0.31 

1.12 

0.97 

1.14 

0.75 

0.00 

0.36 

0.72 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

41028 

0.52 

73 

39 

0.25 

0.98 

-0.22 

1.01 

0.13 

0.00 

0.39 

1.05 

41029 

4.31 

58 

6 

0.66 

0.94 

0.08 

2.81 

1.57 

0.00 

0.57 

0.90 

41030 

0.15 

57 

34 

0.31 

1.18 

1.44 

1.51 

1.85 

0.00 

0.31 

0.46 

41031 

0.26 

53 

33 

0.32 

0.95 

-0.41 

0.85 

-0.64 

0.00 

0.47 

1.18 

41032 

0.59 

61 

36 

0.29 

1.06 

0.59 

1.17 

0.96 

0.00 

0.33 

0.75 

41033 

0.55 

54 

30 

0.31 

1.01 

0.12 

1.00 

0.05 

0.00 

0.44 

0.98 

41034 

0.39 

53 

33 

0.32 

0.99 

-0.01 

0.90 

-0.40 

0.00 

0.48 

1.06 

41035 

1.45 

56 

20 

0.33 

1.13 

0.93 

1.14 

0.57 

0.00 

0.44 

0.76 

41036 

2.22 

44 

14 

0.38 

1.32 

1.67 

1.99 

2.33 

0.00 

0.25 

0.33 

41037 

1.86 

53 

14 

0.34 

1.11 

0.69 

1.41 

1.24 

0.00 

0.27 

0.75 

41038 

1.55 

55 

17 

0.33 

1.35 

1.93 

1.68 

2.38 

0.00 

0.21 

0.38 

41039 

1.74 

63 

18 

0.30 

1.09 

0.67 

1.03 

0.20 

0.00 

0.31 

0.86 

41040 

2.47 

57 

16 

0.36 

1.24 

1.25 

2.52 

3.00 

0.00 

0.39 

0.52 

41041 

1.51 

52 

18 

0.33 

1.25 

1.65 

1.21 

0.64 

0.00 

0.32 

0.51 

41042 

1.96 

55 

14 

0.35 

1.22 

1.22 

1.58 

1.63 

0.00 

0.27 

0.60 

41043 

-2.10 

47 

43 

0.55 

1.01 

0.15 

0.96 

0.20 

0.00 

0.25 

0.99 

41044 

-1.06 

54 

45 

0.39 

1.02 

0.15 

0.77 

-0.46 

0.00 

0.32 

1.03 

41045 

-1.29 

71 

60 

0.36 

0.92 

-0.30 

0.64 

-0.80 

0.00 

0.47 

1.12 

41046 

-3.35 

49 

48 

1.02 

0.86 

0.15 

0.19 

-0.48 

0.00 

0.29 

1.11 

41047 

-2.61 

54 

51 

0.61 

0.95 

0.06 

0.48 

-0.28 

0.00 

0.25 

1.07 

41048 

-2.59 

55 

52 

0.62 

0.93 

0.01 

0.56 

-0.19 

0.00 

0.28 

1.06 

41049 

-1.66 

54 

49 

0.49 

0.84 

-0.36 

0.64 

-0.23 

0.00 

0.37 

1.12 

41050 

-1.68 

3049 

2676 

0.06 

0.91 

-2.41 

0.78 

-2.81 

0.00 

0.41 

1.09 

41051 

0.35 

73 

41 

0.26 

0.97 

-0.24 

0.89 

-0.55 

0.00 

0.46 

1.12 

41052 

-0.22 

59 

39 

0.31 

0.89 

-0.74 

0.85 

-0.47 

0.00 

0.51 

1.20 

41053 

-0.18 

54 

37 

0.33 

0.98 

-0.06 

0.94 

-0.18 

0.00 

0.44 

1.04 

41054 

0.65 

56 

31 

0.31 

0.82 

-1.51 

0.73 

-1.13 

0.00 

0.60 

1.43 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

41055 

0.29 

61 

33 

0.28 

0.81 

-2.05 

0.76 

-1.60 

0.00 

0.54 

1.66 

41056 

0.26 

54 

32 

0.31 

0.95 

-0.41 

0.84 

-0.57 

0.00 

0.48 

1.19 

41057 

-0.16 

55 

39 

0.33 

0.85 

-1.07 

0.69 

-1.04 

0.00 

0.50 

1.34 

41058 

-0.37 

54 

34 

0.32 

0.82 

-1.39 

0.70 

-1.19 

0.00 

0.59 

1.42 

41059 

0.40 

58 

35 

0.30 

0.95 

-0.42 

0.86 

-0.61 

0.00 

0.47 

1.18 

41060 

0.68 

57 

32 

0.30 

0.89 

-0.96 

0.87 

-0.51 

0.00 

0.51 

1.30 

41061 

-0.44 

56 

43 

0.35 

0.78 

-1.27 

0.58 

-0.92 

0.00 

0.55 

1.34 

41062 

0.15 

55 

35 

0.31 

0.75 

-2.35 

0.71 

-1.68 

0.00 

0.55 

1.72 

41063 

0.34 

54 

31 

0.31 

0.80 

-1.75 

0.72 

-1.52 

0.00 

0.60 

1.54 

41064 

-1.39 

55 

49 

0.46 

0.94 

-0.08 

0.49 

-0.77 

0.00 

0.41 

1.11 

41065 

-1.21 

50 

43 

0.43 

0.95 

-0.10 

0.76 

-0.16 

0.00 

0.32 

1.08 

41066 

-0.30 

55 

37 

0.31 

0.94 

-0.52 

0.79 

-0.57 

0.00 

0.45 

1.21 

41067 

-1.21 

54 

43 

0.39 

0.77 

-1.06 

0.78 

-0.30 

0.00 

0.55 

1.24 

41068 

-0.73 

46 

36 

0.40 

0.82 

-0.76 

0.71 

-0.51 

0.00 

0.55 

1.21 

41069 

-0.68 

59 

42 

0.33 

1.12 

0.79 

0.93 

-0.14 

0.00 

0.41 

0.88 

41070 

-0.99 

63 

50 

0.34 

1.05 

0.34 

0.97 

0.07 

-0.01 

0.35 

0.95 

41071 

-1.22 

51 

43 

0.43 

0.81 

-0.64 

0.54 

-0.69 

0.00 

0.51 

1.21 

41072 

-0.97 

54 

43 

0.36 

0.96 

-0.15 

0.85 

-0.27 

-0.01 

0.37 

1.07 

41073 

-1.13 

62 

51 

0.36 

0.89 

-0.46 

0.93 

-0.07 

0.00 

0.44 

1.10 

41074 

-0.99 

56 

46 

0.37 

1.00 

0.07 

0.85 

-0.18 

0.00 

0.32 

1.02 

41075 

-0.20 

54 

39 

0.33 

0.92 

-0.49 

0.79 

-0.70 

0.00 

0.46 

1.18 

41076 

-0.98 

58 

44 

0.35 

0.89 

-0.53 

0.76 

-0.68 

0.00 

0.54 

1.16 

41077 

0.53 

55 

31 

0.30 

1.06 

0.56 

0.99 

-0.01 

0.00 

0.40 

0.88 

41078 

0.97 

73 

32 

0.27 

0.74 

-2.50 

0.65 

-2.36 

0.00 

0.67 

1.62 

41079 

-0.40 

62 

41 

0.31 

0.83 

-1.27 

0.77 

-1.08 

0.00 

0.55 

1.32 

41080 

0.43 

70 

40 

0.27 

0.97 

-0.29 

0.93 

-0.36 

0.00 

0.47 

1.11 

41081 

0.13 

52 

33 

0.32 

1.06 

0.47 

0.94 

-0.24 

0.00 

0.40 

0.94 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

41082 

1.97 

55 

12 

0.36 

1.08 

0.47 

1.81 

1.90 

0.00 

0.32 

0.83 

41083 

1.16 

55 

22 

0.31 

1.03 

0.28 

1.03 

0.22 

0.00 

0.39 

0.92 

41084 

2.13 

262 

85 

0.14 

1.01 

0.11 

0.99 

-0.08 

0.00 

0.40 

0.99 

41085 

0.18 

62 

38 

0.30 

0.97 

-0.19 

1.16 

0.77 

0.00 

0.46 

1.00 

41086 

1.67 

3042 

1007 

0.04 

1.10 

5.00 

1.27 

6.86 

0.00 

0.37 

0.77 

41087 

0.22 

56 

33 

0.31 

1.17 

1.32 

1.32 

1.65 

0.00 

0.30 

0.55 

41088 

2.43 

55 

13 

0.36 

0.92 

-0.37 

1.19 

0.65 

0.00 

0.45 

1.03 

41089 

-1.44 

58 

49 

0.41 

1.06 

0.31 

1.56 

1.11 

0.00 

0.36 

0.90 

41090 

0.31 

53 

32 

0.31 

0.85 

-1.28 

0.76 

-0.99 

0.00 

0.52 

1.45 

41091 

-0.67 

67 

52 

0.32 

0.78 

-1.43 

0.59 

-1.05 

-0.01 

0.53 

1.34 

41092 

0.56 

49 

28 

0.33 

0.77 

-2.36 

0.69 

-1.60 

0.00 

0.57 

1.90 

41093 

-0.89 

46 

36 

0.39 

0.74 

-1.34 

0.52 

-1.22 

0.00 

0.61 

1.37 

41094 

1.13 

53 

20 

0.32 

1.11 

0.86 

1.24 

1.12 

0.00 

0.34 

0.69 

41095 

-0.54 

49 

37 

0.37 

0.71 

-1.64 

0.65 

-1.26 

0.00 

0.56 

1.40 

41096 

-0.01 

56 

33 

0.30 

1.10 

0.95 

1.15 

0.93 

0.00 

0.30 

0.69 

41097 

-0.19 

55 

36 

0.33 

0.76 

-1.71 

0.60 

-1.49 

0.00 

0.62 

1.49 

41098 

1.42 

54 

21 

0.32 

0.85 

-1.08 

0.82 

-0.45 

0.00 

0.56 

1.30 

41099 

-0.31 

66 

51 

0.32 

0.83 

-1.03 

0.70 

-1.02 

-0.01 

0.52 

1.24 

41100 

0.37 

53 

31 

0.31 

1.20 

1.62 

1.36 

1.65 

0.00 

0.28 

0.39 

41151 

-1.30 

55 

47 

0.41 

1.06 

0.34 

0.83 

-0.14 

0.00 

0.29 

0.97 

41152 

-1.10 

55 

46 

0.39 

0.99 

0.04 

1.18 

0.51 

0.00 

0.31 

0.96 

41153 

0.92 

51 

22 

0.33 

0.77 

-1.77 

0.68 

-1.54 

0.00 

0.63 

1.53 

41154 

-0.89 

54 

43 

0.37 

1.10 

0.54 

0.92 

-0.03 

-0.01 

0.33 

0.92 

41155 

-0.65 

54 

41 

0.35 

1.06 

0.36 

0.88 

-0.19 

0.00 

0.40 

0.97 

41156 

-1.65 

57 

50 

0.43 

0.83 

-0.60 

0.45 

-0.80 

0.00 

0.46 

1.20 

41157 

-1.34 

57 

49 

0.42 

0.81 

-0.63 

0.58 

-0.95 

0.00 

0.50 

1.18 

41158 

-1.19 

54 

44 

0.39 

0.92 

-0.29 

0.72 

-0.44 

0.00 

0.46 

1.11 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

41159 

-1.54 

54 

46 

0.41 

0.81 

-0.71 

0.48 

-1.19 

-0.01 

0.54 

1.23 

41160 

0.78 

54 

28 

0.30 

0.98 

-0.20 

0.99 

-0.01 

0.00 

0.39 

1.07 

41161 

0.86 

55 

25 

0.31 

1.23 

1.86 

1.40 

1.78 

0.00 

0.28 

0.37 

41162 

1.37 

58 

23 

0.30 

1.26 

2.04 

1.58 

2.76 

0.00 

0.17 

0.23 

41163 

2.48 

55 

12 

0.36 

1.09 

0.49 

1.05 

0.26 

0.00 

0.31 

0.90 

41164 

1.38 

65 

26 

0.30 

0.84 

-1.26 

0.74 

-1.23 

0.00 

0.60 

1.35 

41165 

1.00 

51 

22 

0.32 

0.94 

-0.48 

0.85 

-0.52 

0.00 

0.50 

1.20 

41166 

1.16 

53 

22 

0.32 

1.01 

0.13 

0.98 

-0.03 

0.00 

0.46 

0.99 

41167 

-1.77 

67 

59 

0.41 

0.92 

-0.22 

0.80 

-0.23 

0.00 

0.41 

1.08 

41168 

-0.94 

54 

44 

0.38 

0.92 

-0.28 

0.87 

-0.28 

0.00 

0.39 

1.09 

41169 

0.30 

55 

31 

0.30 

1.19 

1.68 

1.40 

1.83 

0.00 

0.22 

0.32 

41170 

-2.92 

57 

55 

0.73 

0.95 

0.13 

0.43 

-0.43 

0.00 

0.25 

1.06 

41171 

1.44 

55 

21 

0.32 

1.05 

0.38 

1.09 

0.50 

0.00 

0.42 

0.88 

41172 

1.02 

55 

27 

0.30 

1.10 

0.87 

1.10 

0.71 

0.00 

0.35 

0.71 

41173 

2.41 

52 

10 

0.37 

1.26 

1.23 

3.26 

3.90 

0.00 

-0.09 

0.47 

41174 

-2.89 

58 

55 

0.62 

0.92 

-0.02 

0.37 

-0.52 

-0.01 

0.34 

1.10 

41175 

1.10 

55 

23 

0.32 

0.98 

-0.10 

1.00 

0.05 

0.00 

0.51 

1.02 

41176 

-1.36 

54 

46 

0.43 

1.04 

0.24 

0.96 

0.07 

0.00 

0.40 

0.98 

41177 

3.14 

52 

8 

0.46 

1.24 

0.86 

1.52 

0.90 

0.00 

0.35 

0.76 

41178 

2.53 

59 

11 

0.36 

1.15 

0.78 

4.08 

3.76 

0.00 

0.08 

0.60 

41179 

1.08 

56 

23 

0.30 

0.90 

-0.95 

0.79 

-0.88 

0.00 

0.50 

1.37 

41180 

0.99 

55 

26 

0.31 

1.22 

1.65 

1.21 

1.07 

0.00 

0.36 

0.52 

41181 

0.24 

55 

31 

0.32 

1.02 

0.23 

0.96 

-0.08 

0.00 

0.49 

0.97 

41182 

1.29 

55 

20 

0.30 

0.90 

-0.78 

0.91 

-0.52 

0.00 

0.48 

1.23 

41183 

0.52 

57 

27 

0.29 

1.18 

1.66 

1.25 

1.51 

0.00 

0.25 

0.41 

41184 

-1.10 

55 

46 

0.39 

1.09 

0.46 

0.98 

0.12 

-0.01 

0.25 

0.92 

41185 

-0.12 

58 

38 

0.30 

0.94 

-0.44 

0.86 

-0.60 

0.00 

0.47 

1.17 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

41186 

1.98 

261 

98 

0.14 

0.96 

-0.71 

0.92 

-0.85 

0.00 

0.45 

1.11 

41187 

2.23 

55 

14 

0.36 

1.32 

1.53 

1.58 

1.55 

0.00 

0.28 

0.56 

41188 

1.57 

55 

18 

0.34 

0.97 

-0.09 

2.28 

3.08 

0.00 

0.47 

0.87 

41189 

1.41 

57 

23 

0.30 

0.98 

-0.12 

0.88 

-0.52 

0.00 

0.48 

1.09 

41190 

2.16 

55 

16 

0.34 

0.97 

-0.14 

0.87 

-0.40 

0.00 

0.49 

1.07 

41191 

1.21 

55 

23 

0.30 

0.87 

-1.13 

0.78 

-1.16 

0.00 

0.54 

1.40 

41192 

2.28 

51 

11 

0.38 

1.14 

0.70 

1.56 

1.25 

0.00 

0.28 

0.75 

41193 

-0.34 

55 

40 

0.33 

0.92 

-0.45 

0.82 

-0.61 

0.00 

0.46 

1.15 

41194 

-2.12 

59 

53 

0.49 

0.83 

-0.37 

0.64 

-0.39 

0.00 

0.52 

1.12 

41195 

0.10 

50 

31 

0.32 

0.96 

-0.24 

0.91 

-0.45 

0.00 

0.47 

1.11 

41196 

1.17 

70 

28 

0.27 

1.07 

0.61 

1.20 

1.05 

0.00 

0.38 

0.79 

41197 

-0.28 

55 

39 

0.34 

0.94 

-0.31 

0.91 

-0.13 

0.00 

0.50 

1.09 

41198 

-1.63 

55 

48 

0.44 

1.00 

0.09 

0.65 

-0.38 

-0.01 

0.36 

1.05 

41199 

0.14 

70 

45 

0.28 

0.93 

-0.61 

0.94 

-0.23 

0.00 

0.47 

1.15 

41200 

-0.49 

56 

41 

0.33 

1.01 

0.12 

0.94 

-0.11 

0.00 

0.39 

1.00 

4G11 

0.53 

230 

161 

0.16 

1.13 

1.81 

1.21 

1.54 

0.00 

0.28 

0.73 

4G110 

-0.42 

113 

95 

0.28 

0.90 

-0.50 

0.69 

-1.01 

0.00 

0.41 

1.13 

4G111 

2.16 

100 

35 

0.23 

0.99 

-0.10 

0.93 

-0.41 

0.00 

0.44 

1.05 

4G112 

0.51 

94 

66 

0.24 

1.10 

0.92 

1.06 

0.37 

0.00 

0.28 

0.82 

4G113 

0.08 

111 

88 

0.25 

0.90 

-0.74 

0.75 

-0.96 

0.00 

0.42 

1.16 

4G114 

-0.56 

122 

102 

0.26 

1.09 

0.62 

1.05 

0.27 

0.00 

0.21 

0.91 

4G115 

-0.04 

93 

67 

0.25 

1.01 

0.15 

0.98 

-0.03 

0.00 

0.31 

0.99 

4G116 

3.14 

98 

19 

0.28 

1.21 

1.27 

1.69 

2.45 

0.00 

0.08 

0.68 

4G117 

-0.71 

101 

88 

0.31 

0.89 

-0.50 

0.75 

-0.65 

0.00 

0.39 

1.11 

4G118 

0.38 

116 

75 

0.21 

1.00 

-0.01 

1.01 

0.15 

0.00 

0.33 

1.00 

4G119 

0.41 

113 

82 

0.23 

1.32 

2.81 

1.49 

2.66 

0.00 

0.01 

0.38 

4G12 

-0.08 

232 

185 

0.18 

0.98 

-0.22 

0.86 

-0.65 

0.00 

0.37 

1.05 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4G120 

-0.21 

98 

79 

0.27 

1.05 

0.38 

1.18 

0.78 

0.00 

0.19 

0.89 

4G121 

2.01 

110 

51 

0.21 

1.10 

1.38 

1.17 

1.62 

0.00 

0.28 

0.60 

4G122 

-0.72 

107 

89 

0.28 

0.93 

-0.39 

0.88 

-0.31 

0.00 

0.42 

1.07 

4G123 

-0.66 

201 

177 

0.23 

0.98 

-0.05 

1.11 

0.50 

0.00 

0.23 

1.00 

4G124 

2.64 

209 

48 

0.18 

1.07 

0.80 

1.45 

2.89 

0.00 

0.19 

0.81 

4G125 

0.54 

110 

79 

0.23 

1.00 

-0.01 

0.96 

-0.15 

0.00 

0.38 

1.02 

4G126 

-0.29 

128 

103 

0.25 

1.14 

1.03 

1.16 

0.59 

0.00 

0.28 

0.83 

4G127 

1.14 

105 

63 

0.22 

1.03 

0.39 

1.06 

0.53 

0.00 

0.34 

0.89 

4G128 

1.18 

96 

52 

0.22 

1.01 

0.11 

1.13 

0.99 

0.00 

0.37 

0.91 

4G129 

1.19 

92 

53 

0.23 

1.18 

2.11 

1.28 

2.07 

0.00 

0.19 

0.33 

4G13 

2.11 

103 

43 

0.22 

1.01 

0.13 

1.04 

0.37 

0.00 

0.42 

0.96 

4G130 

-1.98 

121 

115 

0.43 

0.94 

-0.06 

0.60 

-0.68 

0.00 

0.28 

1.05 

4G131 

-0.15 

214 

163 

0.17 

0.96 

-0.47 

0.87 

-0.88 

0.00 

0.38 

1.08 

4G132 

-0.69 

90 

74 

0.29 

0.93 

-0.39 

0.80 

-0.60 

0.00 

0.35 

1.10 

4G133 

0.04 

94 

73 

0.26 

1.02 

0.18 

1.10 

0.49 

0.00 

0.26 

0.94 

4G14 

1.51 

91 

46 

0.23 

1.18 

2.27 

1.19 

1.72 

0.00 

0.19 

0.33 

4G15 

0.40 

111 

71 

0.21 

0.85 

-1.97 

0.79 

-2.15 

0.00 

0.53 

1.48 

4G16 

0.11 

110 

85 

0.24 

0.96 

-0.27 

0.86 

-0.66 

0.00 

0.38 

1.08 

4G17 

0.19 

91 

67 

0.25 

1.16 

1.35 

1.41 

1.93 

0.00 

0.12 

0.63 

4G18 

1.77 

99 

51 

0.22 

1.18 

2.43 

1.19 

1.69 

0.00 

0.20 

0.32 

4G19 

1.29 

104 

51 

0.22 

0.98 

-0.20 

0.98 

-0.17 

0.00 

0.44 

1.06 

4G21 

0.22 

107 

82 

0.24 

0.89 

-0.87 

0.83 

-0.77 

0.00 

0.40 

1.17 

4G210 

0.72 

96 

61 

0.23 

0.96 

-0.39 

0.94 

-0.30 

0.00 

0.41 

1.09 

4G211 

-3.31 

92 

91 

1.01 

0.95 

0.27 

0.23 

-0.59 

0.00 

0.21 

1.07 

4G212 

0.05 

106 

85 

0.26 

1.09 

0.69 

1.55 

1.81 

0.00 

0.17 

0.80 

4G213 

0.11 

121 

89 

0.22 

0.99 

-0.02 

1.01 

0.13 

0.00 

0.35 

1.01 

4G214 

-0.10 

93 

68 

0.25 

1.06 

0.59 

0.95 

-0.17 

0.00 

0.28 

0.92 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4G215 

-0.06 

96 

76 

0.26 

0.99 

-0.03 

0.89 

-0.35 

0.00 

0.32 

1.03 

4G216 

1.86 

93 

40 

0.23 

1.07 

0.87 

1.21 

1.78 

0.00 

0.29 

0.69 

4G217 

-0.32 

114 

88 

0.23 

0.99 

-0.01 

0.91 

-0.48 

0.00 

0.32 

1.04 

4G218 

1.23 

110 

62 

0.21 

1.17 

2.26 

1.18 

1.79 

0.00 

0.20 

0.41 

4G219 

-0.77 

92 

80 

0.32 

1.00 

0.05 

0.83 

-0.39 

0.00 

0.24 

1.02 

4G22 

1.46 

108 

62 

0.21 

1.10 

1.33 

1.22 

1.85 

0.00 

0.25 

0.60 

4G220 

-0.87 

104 

89 

0.30 

0.95 

-0.21 

0.86 

-0.35 

0.00 

0.36 

1.05 

4G221 

-0.90 

188 

167 

0.24 

0.95 

-0.22 

0.76 

-0.75 

0.00 

0.31 

1.06 

4G222 

-1.12 

110 

101 

0.36 

0.93 

-0.18 

0.57 

-0.83 

0.00 

0.33 

1.08 

4G223 

1.01 

122 

73 

0.21 

1.13 

1.56 

1.18 

1.18 

0.00 

0.35 

0.65 

4G224 

0.91 

109 

71 

0.22 

1.12 

1.33 

1.04 

0.27 

0.00 

0.31 

0.76 

4G225 

-0.05 

120 

94 

0.24 

1.10 

0.82 

1.15 

0.63 

0.00 

0.28 

0.84 

4G226 

1.51 

105 

55 

0.21 

1.03 

0.46 

1.02 

0.24 

0.00 

0.36 

0.89 

4G227 

-1.08 

95 

85 

0.35 

0.86 

-0.52 

0.58 

-0.93 

0.00 

0.40 

1.13 

4G228 

0.52 

90 

64 

0.25 

0.85 

-1.42 

0.72 

-1.51 

0.00 

0.51 

1.34 

4G229 

-0.35 

103 

88 

0.29 

0.85 

-0.79 

0.61 

-1.18 

0.00 

0.43 

1.17 

4G23 

-1.04 

213 

192 

0.24 

0.96 

-0.17 

0.92 

-0.18 

0.00 

0.29 

1.02 

4G230 

2.20 

120 

38 

0.21 

0.94 

-0.62 

0.95 

-0.31 

0.00 

0.41 

1.11 

4G231 

1.32 

90 

40 

0.23 

0.92 

-1.01 

0.95 

-0.36 

0.00 

0.47 

1.24 

4G232 

0.41 

209 

141 

0.16 

0.91 

-1.49 

0.88 

-1.14 

0.00 

0.44 

1.23 

4G233 

1.52 

94 

46 

0.22 

0.91 

-1.20 

0.88 

-1.11 

0.00 

0.49 

1.33 

4G24 

0.35 

91 

67 

0.25 

0.98 

-0.11 

1.38 

1.76 

0.00 

0.31 

0.99 

4G25 

0.70 

111 

64 

0.20 

1.09 

1.32 

1.13 

1.50 

0.00 

0.21 

0.62 

4G26 

1.44 

189 

88 

0.16 

1.02 

0.43 

1.06 

0.75 

0.00 

0.37 

0.90 

4G27 

0.23 

110 

83 

0.24 

1.02 

0.19 

1.00 

0.08 

0.00 

0.32 

0.98 

4G28 

1.10 

89 

50 

0.23 

1.10 

1.26 

1.14 

1.29 

0.00 

0.27 

0.62 

4G29 

1.96 

95 

45 

0.22 

1.04 

0.56 

1.17 

1.60 

0.00 

0.31 

0.74 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4G31 

2.44 

107 

36 

0.23 

1.12 

1.17 

1.10 

0.74 

0.00 

0.33 

0.77 

4G310 

0.61 

96 

63 

0.23 

1.14 

1.44 

1.29 

1.60 

0.00 

0.22 

0.60 

4G311 

1.30 

92 

51 

0.23 

1.41 

4.64 

1.46 

3.37 

0.00 

-0.01 

-0.41 

4G312 

0.36 

106 

80 

0.24 

1.00 

0.03 

0.94 

-0.20 

0.00 

0.34 

1.01 

4G313 

0.64 

121 

77 

0.20 

1.29 

3.31 

1.45 

3.57 

0.00 

0.04 

0.17 

4G314 

0.47 

93 

58 

0.23 

1.26 

2.97 

1.31 

2.00 

0.00 

0.09 

0.16 

4G315 

0.72 

96 

63 

0.23 

1.27 

2.79 

1.33 

2.00 

0.00 

0.08 

0.28 

4G316 

0.93 

93 

58 

0.23 

1.34 

3.66 

1.57 

3.60 

0.00 

-0.02 

-0.12 

4G317 

-0.27 

114 

87 

0.23 

1.25 

1.97 

1.54 

2.83 

0.00 

-0.09 

0.54 

4G318 

0.23 

110 

83 

0.24 

0.96 

-0.27 

0.88 

-0.61 

0.00 

0.39 

1.08 

4G319 

-0.32 

92 

75 

0.28 

0.96 

-0.21 

0.82 

-0.64 

0.00 

0.31 

1.07 

4G32 

0.94 

107 

73 

0.22 

1.03 

0.35 

1.00 

0.07 

0.00 

0.32 

0.94 

4G320 

-2.93 

228 

224 

0.51 

0.91 

-0.04 

0.32 

-1.22 

0.00 

0.25 

1.07 

4G321 

-0.62 

104 

86 

0.28 

0.99 

-0.02 

0.85 

-0.47 

0.00 

0.37 

1.04 

4G322 

-2.33 

110 

107 

0.59 

1.04 

0.25 

0.79 

0.01 

0.00 

0.11 

0.98 

4G323 

0.10 

232 

179 

0.17 

0.96 

-0.50 

0.83 

-0.96 

0.00 

0.41 

1.09 

4G324 

-0.04 

122 

95 

0.24 

0.97 

-0.24 

0.83 

-0.61 

0.00 

0.40 

1.07 

4G325 

0.04 

104 

76 

0.24 

0.92 

-0.64 

0.82 

-0.95 

0.00 

0.47 

1.15 

4G326 

-0.49 

109 

94 

0.29 

0.89 

-0.57 

0.91 

-0.11 

0.00 

0.38 

1.10 

4G327 

0.14 

119 

90 

0.23 

1.01 

0.17 

1.16 

0.69 

0.00 

0.36 

0.95 

4G328 

1.21 

192 

108 

0.16 

1.10 

1.72 

1.07 

0.91 

0.00 

0.29 

0.69 

4G329 

0.08 

104 

82 

0.25 

1.14 

1.05 

1.25 

1.02 

0.00 

0.16 

0.78 

4G33 

1.75 

94 

40 

0.23 

1.12 

1.41 

1.10 

0.78 

0.00 

0.31 

0.66 

4G330 

0.42 

89 

65 

0.26 

0.95 

-0.40 

0.86 

-0.64 

0.00 

0.40 

1.12 

4G331 

0.35 

103 

78 

0.25 

1.15 

1.27 

1.04 

0.26 

0.00 

0.22 

0.79 

4G332 

1.98 

119 

43 

0.21 

1.39 

4.35 

1.52 

3.92 

0.00 

-0.06 

-0.08 

4G333 

0.67 

205 

136 

0.16 

0.84 

-2.61 

0.77 

-2.45 

0.00 

0.51 

1.42 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4G334 

0.77 

89 

50 

0.23 

1.07 

0.97 

1.24 

1.74 

0.00 

0.28 

0.64 

4G34 

1.13 

91 

52 

0.23 

1.16 

1.92 

1.56 

3.88 

0.00 

0.17 

0.28 

4G35 

3.01 

91 

20 

0.27 

1.09 

0.66 

1.34 

1.44 

0.00 

0.22 

0.83 

4G36 

2.09 

104 

29 

0.23 

0.99 

-0.02 

0.93 

-0.45 

0.00 

0.33 

1.04 

4G37 

1.18 

110 

63 

0.21 

1.12 

1.57 

1.18 

1.71 

0.00 

0.24 

0.57 

4G38 

1.58 

89 

41 

0.23 

1.22 

2.52 

1.29 

2.66 

0.00 

0.17 

0.21 

4G39 

3.01 

89 

24 

0.26 

0.97 

-0.22 

1.10 

0.59 

0.00 

0.38 

1.01 

4MD11 

2.67 

109 

32 

0.23 

1.13 

1.15 

1.14 

0.89 

0.00 

0.32 

0.78 

4MD110 

0.49 

99 

67 

0.23 

0.89 

-1.16 

0.89 

-0.55 

0.00 

0.47 

1.24 

4MD12 

2.68 

93 

26 

0.25 

1.26 

1.96 

1.60 

2.89 

0.00 

0.09 

0.48 

4MD13 

4.29 

109 

11 

0.34 

1.02 

0.18 

2.28 

2.36 

0.00 

0.20 

0.88 

4MD14 

0.25 

122 

87 

0.21 

1.02 

0.21 

0.99 

-0.02 

0.00 

0.35 

0.98 

4MD15 

0.52 

93 

57 

0.23 

0.98 

-0.23 

1.01 

0.10 

0.00 

0.37 

1.04 

4MD16 

0.64 

97 

65 

0.23 

0.90 

-1.13 

0.78 

-1.43 

0.00 

0.47 

1.31 

4MD17 

1.96 

100 

40 

0.22 

0.97 

-0.27 

1.00 

0.05 

0.00 

0.41 

1.05 

4MD18 

-0.46 

205 

173 

0.20 

0.91 

-0.68 

0.77 

-1.15 

0.00 

0.37 

1.11 

4MD19 

-0.83 

116 

98 

0.27 

0.97 

-0.13 

0.82 

-0.73 

0.00 

0.33 

1.06 

4MD31 

1.87 

112 

48 

0.21 

0.94 

-0.73 

0.91 

-0.92 

0.00 

0.46 

1.20 

4MD310 

1.34 

97 

50 

0.22 

0.87 

-1.79 

0.85 

-1.59 

0.00 

0.51 

1.48 

4MD32 

2.01 

110 

51 

0.21 

1.14 

2.00 

1.15 

1.51 

0.00 

0.25 

0.47 

4MD33 

-0.97 

106 

92 

0.30 

0.88 

-0.58 

0.89 

-0.22 

0.00 

0.41 

1.10 

4MD34 

1.13 

110 

67 

0.21 

0.92 

-1.04 

0.85 

-1.04 

0.00 

0.49 

1.26 

4MD35 

0.95 

123 

75 

0.21 

0.93 

-0.87 

0.81 

-1.28 

0.00 

0.50 

1.23 

4MD36 

0.96 

106 

67 

0.22 

0.85 

-1.94 

0.79 

-1.61 

0.00 

0.49 

1.46 

4MD37 

0.09 

96 

72 

0.25 

0.85 

-1.23 

0.70 

-1.33 

0.00 

0.49 

1.27 

4MD38 

-0.08 

92 

74 

0.28 

0.89 

-0.67 

0.81 

-0.64 

0.00 

0.41 

1.14 

4MD39 

1.33 

212 

115 

0.15 

0.89 

-2.07 

0.86 

-1.72 

0.00 

0.51 

1.35 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4MD41 

2.53 

105 

35 

0.23 

0.91 

-0.78 

0.89 

-0.72 

0.00 

0.50 

1.16 

4MD410 

-2.18 

121 

116 

0.46 

0.96 

0.03 

0.71 

-0.33 

0.00 

0.22 

1.03 

4MD411 

1.34 

93 

41 

0.23 

1.06 

0.70 

1.09 

0.78 

0.00 

0.33 

0.80 

4MD412 

1.90 

95 

39 

0.23 

0.89 

-1.23 

0.84 

-1.43 

0.00 

0.51 

1.33 

4MD413 

1.14 

91 

53 

0.23 

1.03 

0.37 

1.00 

0.00 

0.00 

0.34 

0.93 

4MD414 

0.80 

114 

63 

0.20 

1.19 

2.82 

1.21 

2.54 

0.00 

0.09 

0.17 

4MD415 

1.78 

110 

49 

0.21 

1.11 

1.48 

1.18 

1.82 

0.00 

0.25 

0.57 

4MD416 

-0.64 

230 

199 

0.20 

0.89 

-0.82 

1.99 

3.06 

0.00 

0.32 

1.05 

4MD417 

1.41 

92 

45 

0.23 

0.90 

-1.29 

0.85 

-1.55 

0.00 

0.49 

1.40 

4MD418 

1.58 

107 

59 

0.21 

0.96 

-0.53 

0.93 

-0.62 

0.00 

0.41 

1.16 

4MD419 

2.27 

104 

31 

0.23 

1.18 

1.69 

1.68 

3.29 

0.00 

0.17 

0.54 

4MD42 

2.03 

110 

47 

0.21 

1.28 

3.11 

1.44 

3.27 

0.00 

0.17 

0.19 

4MD420 

1.01 

121 

73 

0.21 

0.83 

-2.18 

0.73 

-1.94 

0.00 

0.56 

1.46 

4MD43 

2.41 

106 

36 

0.23 

1.09 

0.92 

1.17 

1.17 

0.00 

0.34 

0.78 

4MD44 

2.38 

96 

29 

0.24 

1.16 

1.34 

1.77 

3.73 

0.00 

0.17 

0.54 

4MD45 

1.35 

92 

50 

0.23 

1.03 

0.38 

0.98 

-0.13 

0.00 

0.37 

0.94 

4MD46 

-0.39 

105 

90 

0.29 

1.07 

0.42 

0.90 

-0.16 

0.00 

0.23 

0.96 

4MD47 

-1.41 

121 

111 

0.34 

0.90 

-0.31 

1.29 

0.80 

0.00 

0.28 

1.04 

4MD48 

1.89 

91 

30 

0.24 

0.88 

-1.11 

0.82 

-1.24 

0.00 

0.52 

1.26 

4MD49 

0.89 

95 

59 

0.23 

1.10 

1.19 

1.14 

1.00 

0.00 

0.26 

0.68 

4MD51 

1.87 

91 

39 

0.23 

0.98 

-0.23 

0.96 

-0.37 

0.00 

0.41 

1.08 

4MD510 

1.34 

113 

49 

0.20 

0.94 

-0.88 

0.93 

-0.82 

0.00 

0.40 

1.25 

4MD511 

0.33 

110 

81 

0.23 

1.11 

0.97 

1.18 

1.01 

0.00 

0.23 

0.81 

4MD512 

0.55 

91 

61 

0.24 

1.17 

1.87 

1.32 

1.93 

0.00 

0.15 

0.47 

4MD513 

1.09 

103 

67 

0.22 

1.04 

0.47 

1.23 

1.55 

0.00 

0.29 

0.84 

4MD514 

0.47 

104 

68 

0.23 

1.12 

1.28 

1.12 

0.82 

0.00 

0.30 

0.74 

4MD515 

0.34 

109 

82 

0.24 

1.00 

0.03 

0.85 

-0.61 

0.00 

0.38 

1.05 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4MD516 

-0.50 

120 

101 

0.27 

0.87 

-0.77 

0.77 

-0.62 

0.00 

0.41 

1.13 

4MD517 

0.21 

188 

140 

0.18 

1.04 

0.49 

1.00 

0.04 

0.00 

0.31 

0.95 

4MD518 

-0.44 

105 

90 

0.29 

1.01 

0.11 

0.88 

-0.28 

0.00 

0.26 

1.01 

4MD519 

0.02 

96 

73 

0.26 

1.19 

1.43 

2.54 

4.51 

0.00 

0.07 

0.56 

4MD52 

-1.42 

92 

86 

0.43 

0.96 

0.01 

0.63 

-0.53 

0.00 

0.26 

1.05 

4MD520 

-0.44 

103 

89 

0.30 

0.87 

-0.65 

0.60 

-1.15 

0.00 

0.41 

1.15 

4MD53 

-0.49 

121 

100 

0.25 

0.92 

-0.49 

0.84 

-0.63 

0.00 

0.39 

1.09 

4MD54 

-0.18 

90 

67 

0.26 

0.98 

-0.12 

0.93 

-0.26 

0.00 

0.33 

1.04 

4MD55 

2.61 

94 

26 

0.25 

1.28 

2.10 

1.56 

2.80 

0.00 

0.07 

0.48 

4MD56 

0.29 

91 

68 

0.26 

0.89 

-0.86 

0.77 

-1.13 

0.00 

0.45 

1.21 

4MD57 

1.69 

111 

40 

0.21 

0.99 

-0.06 

0.98 

-0.18 

0.00 

0.33 

1.02 

4MD58 

0.64 

110 

75 

0.22 

0.96 

-0.37 

0.95 

-0.33 

0.00 

0.40 

1.08 

4MD59 

-0.65 

91 

78 

0.31 

0.89 

-0.53 

0.67 

-1.01 

0.00 

0.36 

1.14 

4MD61 

1.38 

99 

59 

0.22 

1.13 

1.67 

1.23 

1.73 

0.00 

0.22 

0.51 

4MD610 

0.72 

104 

63 

0.22 

1.16 

1.76 

1.20 

1.52 

0.00 

0.27 

0.58 

4MD611 

-2.32 

109 

106 

0.59 

0.99 

0.17 

0.54 

-0.39 

0.00 

0.18 

1.03 

4MD612 

-1.91 

120 

114 

0.43 

0.83 

-0.40 

0.36 

-1.10 

0.00 

0.34 

1.12 

4MD613 

0.07 

105 

83 

0.25 

0.98 

-0.13 

1.04 

0.25 

0.00 

0.30 

1.01 

4MD614 

-0.40 

95 

78 

0.28 

1.12 

0.74 

1.23 

0.77 

0.00 

0.17 

0.84 

4MD615 

-0.37 

90 

76 

0.30 

1.02 

0.17 

0.86 

-0.33 

0.00 

0.28 

1.00 

4MD616 

-0.64 

103 

91 

0.32 

0.98 

-0.01 

0.89 

-0.13 

0.00 

0.27 

1.02 

4MD617 

1.03 

120 

67 

0.20 

1.20 

2.64 

1.21 

2.22 

0.00 

0.17 

0.34 

4MD618 

-0.25 

90 

68 

0.26 

0.98 

-0.12 

1.09 

0.43 

0.00 

0.31 

1.01 

4MD619 

0.42 

94 

67 

0.24 

1.11 

1.04 

1.19 

1.03 

0.00 

0.21 

0.76 

4MD62 

1.44 

227 

115 

0.15 

1.19 

3.50 

1.25 

3.21 

0.00 

0.21 

0.34 

4MD620 

1.61 

91 

44 

0.23 

1.17 

2.14 

1.17 

1.56 

0.00 

0.21 

0.38 

4MD63 

0.22 

111 

75 

0.21 

0.82 

-2.09 

0.77 

-2.10 

0.00 

0.55 

1.45 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4MD64 

1.23 

110 

62 

0.21 

1.02 

0.26 

0.99 

-0.05 

0.00 

0.37 

0.96 

4MD65 

-0.41 

89 

74 

0.29 

1.05 

0.34 

1.35 

1.17 

0.00 

0.17 

0.90 

4MD66 

0.94 

93 

64 

0.24 

1.01 

0.11 

1.01 

0.10 

0.00 

0.32 

0.97 

4MD67 

0.86 

104 

60 

0.22 

1.18 

2.08 

1.24 

1.91 

0.00 

0.24 

0.48 

4MD68 

0.56 

109 

78 

0.23 

0.93 

-0.68 

0.86 

-0.67 

0.00 

0.44 

1.15 

4MD69 

1.03 

118 

71 

0.21 

1.05 

0.64 

1.06 

0.42 

0.00 

0.41 

0.86 

4MD71 

1.97 

105 

45 

0.22 

0.95 

-0.56 

0.92 

-0.70 

0.00 

0.45 

1.16 

4MD710 

1.20 

95 

51 

0.22 

1.07 

0.96 

1.12 

0.93 

0.00 

0.32 

0.72 

4MD711 

2.40 

90 

30 

0.24 

1.29 

2.54 

1.65 

3.68 

0.00 

0.06 

0.25 

4MD712 

1.15 

103 

63 

0.22 

0.96 

-0.54 

0.89 

-0.73 

0.00 

0.44 

1.16 

4MD713 

1.73 

119 

49 

0.20 

1.01 

0.15 

1.04 

0.48 

0.00 

0.36 

0.94 

4MD714 

1.48 

90 

37 

0.23 

0.96 

-0.45 

0.93 

-0.53 

0.00 

0.45 

1.14 

4MD715 

0.67 

93 

62 

0.24 

1.00 

0.07 

0.97 

-0.11 

0.00 

0.35 

1.00 

4MD716 

1.33 

189 

92 

0.16 

1.15 

2.58 

1.16 

1.96 

0.00 

0.25 

0.49 

4MD717 

1.30 

91 

50 

0.23 

0.99 

-0.09 

0.99 

-0.04 

0.00 

0.38 

1.03 

4MD718 

1.59 

106 

40 

0.21 

1.18 

2.24 

1.25 

2.31 

0.00 

0.09 

0.37 

4MD719 

1.70 

110 

51 

0.21 

1.09 

1.27 

1.19 

1.92 

0.00 

0.26 

0.60 

4MD72 

1.80 

89 

37 

0.24 

1.21 

2.20 

1.26 

2.25 

0.00 

0.20 

0.37 

4MD720 

2.02 

91 

42 

0.23 

1.04 

0.48 

1.03 

0.33 

0.00 

0.34 

0.87 

4MD73 

1.62 

104 

44 

0.22 

1.41 

4.38 

1.53 

3.86 

0.00 

0.03 

-0.19 

4MD74 

1.47 

109 

59 

0.21 

1.22 

2.69 

1.68 

4.58 

0.00 

0.18 

0.16 

4MD75 

2.48 

117 

39 

0.23 

0.96 

-0.33 

0.88 

-0.68 

0.00 

0.52 

1.10 

4MD76 

1.65 

103 

43 

0.22 

1.17 

1.99 

1.28 

2.15 

0.00 

0.24 

0.47 

4MD77 

1.47 

108 

58 

0.21 

1.19 

2.29 

1.33 

2.45 

0.00 

0.23 

0.35 

4MD78 

1.80 

116 

53 

0.21 

1.35 

3.62 

1.43 

2.91 

0.00 

0.24 

0.15 

4MD79 

1.19 

104 

61 

0.22 

1.01 

0.12 

0.96 

-0.32 

0.00 

0.37 

1.01 

4NBT11 

0.67 

109 

75 

0.22 

0.96 

-0.45 

0.87 

-0.80 

0.00 

0.39 

1.14 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4NBT110 

-0.18 

99 

78 

0.26 

0.92 

-0.52 

0.85 

-0.47 

0.00 

0.41 

1.10 

4NBT111 

1.66 

92 

44 

0.23 

0.94 

-0.78 

0.90 

-0.85 

0.00 

0.46 

1.23 

4NBT112 

2.31 

109 

40 

0.22 

0.86 

-1.49 

0.86 

-1.04 

0.00 

0.55 

1.29 

4NBT113 

0.64 

122 

78 

0.20 

1.02 

0.31 

1.03 

0.27 

0.00 

0.35 

0.94 

4NBT114 

0.08 

93 

65 

0.24 

1.02 

0.27 

1.02 

0.19 

0.00 

0.31 

0.95 

4NBT115 

0.53 

97 

67 

0.23 

0.91 

-0.93 

1.08 

0.51 

0.00 

0.41 

1.16 

4NBT12 

-0.52 

100 

85 

0.30 

0.90 

-0.50 

0.74 

-0.77 

0.00 

0.40 

1.11 

4NBT13 

1.54 

116 

46 

0.20 

1.14 

2.01 

1.22 

2.31 

0.00 

0.15 

0.43 

4NBT14 

1.32 

112 

61 

0.21 

1.03 

0.44 

1.03 

0.33 

0.00 

0.36 

0.90 

4NBT15 

-0.65 

328 

283 

0.17 

0.93 

-0.58 

1.18 

0.87 

0.00 

0.32 

1.05 

4NBT16 

0.19 

97 

72 

0.25 

0.96 

-0.33 

1.04 

0.25 

0.00 

0.33 

1.05 

4NBT17 

-2.51 

110 

108 

0.72 

0.97 

0.18 

0.58 

-0.25 

0.00 

0.17 

1.03 

4NBT18 

-0.29 

106 

83 

0.25 

0.94 

-0.39 

0.74 

-1.14 

0.00 

0.45 

1.12 

4NBT19 

0.43 

110 

81 

0.23 

0.99 

-0.10 

0.94 

-0.20 

0.00 

0.37 

1.03 

4NBT21 

-1.37 

123 

113 

0.35 

0.90 

-0.33 

0.68 

-0.50 

0.00 

0.32 

1.07 

4NBT210 

-0.56 

106 

92 

0.30 

0.98 

-0.03 

1.09 

0.36 

0.00 

0.24 

1.00 

4NBT211 

0.28 

199 

151 

0.18 

1.14 

1.59 

1.58 

3.08 

0.00 

0.14 

0.68 

4NBT212 

-1.50 

96 

89 

0.41 

0.91 

-0.18 

0.58 

-0.72 

0.00 

0.33 

1.08 

4NBT213 

0.00 

92 

73 

0.27 

0.95 

-0.26 

0.82 

-0.64 

0.00 

0.37 

1.09 

4NBT214 

-0.89 

105 

95 

0.34 

0.91 

-0.30 

0.61 

-0.82 

0.00 

0.34 

1.10 

4NBT215 

-1.01 

121 

107 

0.30 

0.91 

-0.40 

0.75 

-0.73 

0.00 

0.36 

1.08 

4NBT22 

-0.22 

93 

70 

0.25 

0.94 

-0.43 

0.85 

-0.63 

0.00 

0.38 

1.12 

4NBT23 

0.08 

95 

73 

0.26 

0.90 

-0.80 

0.82 

-0.74 

0.00 

0.42 

1.17 

4NBT24 

-2.16 

91 

88 

0.60 

0.94 

0.05 

0.83 

0.04 

0.00 

0.19 

1.03 

4NBT25 

-0.68 

114 

94 

0.26 

0.84 

-1.03 

0.70 

-1.44 

0.00 

0.49 

1.19 

4NBT26 

0.78 

110 

72 

0.22 

1.05 

0.63 

1.02 

0.19 

0.00 

0.32 

0.89 

4NBT27 

-1.77 

92 

87 

0.47 

0.93 

-0.05 

0.53 

-0.74 

0.00 

0.26 

1.07 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4NBT28 

-0.41 

107 

94 

0.31 

0.94 

-0.20 

0.80 

-0.49 

0.00 

0.32 

1.06 

4NBT29 

-0.62 

104 

86 

0.28 

0.94 

-0.31 

0.71 

-1.02 

0.00 

0.42 

1.11 

4NBT31 

0.86 

109 

72 

0.22 

1.02 

0.25 

1.19 

1.14 

0.00 

0.35 

0.89 

4NBT310 

1.74 

121 

56 

0.21 

0.92 

-0.91 

0.86 

-1.08 

0.00 

0.53 

1.21 

4NBT311 

0.45 

106 

77 

0.23 

0.92 

-0.78 

0.93 

-0.33 

0.00 

0.39 

1.15 

4NBT312 

0.27 

96 

69 

0.24 

0.91 

-0.82 

0.80 

-0.97 

0.00 

0.45 

1.21 

4NBT313 

0.65 

92 

63 

0.24 

0.84 

-1.72 

0.74 

-1.58 

0.00 

0.52 

1.40 

4NBT314 

-0.39 

105 

90 

0.29 

0.91 

-0.45 

0.68 

-0.89 

0.00 

0.38 

1.12 

4NBT315 

-0.09 

121 

93 

0.23 

0.86 

-1.17 

0.81 

-1.05 

0.00 

0.48 

1.20 

4NBT32 

0.66 

91 

53 

0.23 

0.94 

-0.75 

0.90 

-0.75 

0.00 

0.43 

1.23 

4NBT33 

0.02 

95 

74 

0.26 

0.92 

-0.59 

0.80 

-0.79 

0.00 

0.40 

1.14 

4NBT34 

0.66 

214 

131 

0.15 

1.01 

0.20 

0.98 

-0.17 

0.00 

0.37 

0.98 

4NBT35 

-0.14 

91 

74 

0.28 

0.96 

-0.18 

0.85 

-0.49 

0.00 

0.34 

1.06 

4NBT36 

1.34 

113 

49 

0.20 

1.09 

1.34 

1.09 

1.08 

0.00 

0.22 

0.64 

4NBT37 

-0.34 

110 

92 

0.27 

0.96 

-0.17 

0.95 

-0.11 

0.00 

0.32 

1.03 

4NBT38 

0.66 

91 

59 

0.24 

1.00 

0.01 

0.96 

-0.22 

0.00 

0.35 

1.02 

4NBT39 

0.20 

102 

82 

0.26 

0.85 

-1.04 

0.71 

-1.18 

0.00 

0.47 

1.21 

4NBT41 

-0.02 

104 

77 

0.24 

0.96 

-0.33 

0.95 

-0.18 

0.00 

0.42 

1.06 

4NBT410 

-1.11 

109 

100 

0.36 

0.87 

-0.43 

0.46 

-1.16 

0.00 

0.39 

1.13 

4NBT411 

-2.11 

120 

115 

0.47 

0.98 

0.08 

0.55 

-0.52 

0.00 

0.24 

1.05 

4NBT412 

0.80 

105 

70 

0.22 

1.02 

0.25 

1.07 

0.48 

0.00 

0.32 

0.93 

4NBT413 

-1.50 

96 

89 

0.41 

1.01 

0.15 

1.03 

0.24 

0.00 

0.19 

0.99 

4NBT414 

-0.58 

226 

189 

0.19 

0.92 

-0.64 

0.85 

-0.80 

0.00 

0.37 

1.09 

4NBT415 

0.10 

91 

71 

0.27 

1.00 

0.05 

0.93 

-0.21 

0.00 

0.32 

1.01 

4NBT416 

-0.35 

103 

88 

0.29 

1.03 

0.20 

1.01 

0.15 

0.00 

0.26 

0.98 

4NBT417 

0.47 

121 

81 

0.21 

0.86 

-1.66 

0.86 

-1.16 

0.00 

0.50 

1.31 

4NBT418 

0.79 

90 

50 

0.23 

1.05 

0.63 

0.98 

-0.08 

0.00 

0.35 

0.88 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4NBT419 

0.59 

94 

64 

0.24 

0.84 

-1.76 

0.74 

-1.60 

0.00 

0.52 

1.41 

4NBT42 

1.20 

91 

52 

0.23 

0.91 

-1.23 

0.85 

-1.26 

0.00 

0.47 

1.37 

4NBT420 

0.27 

111 

74 

0.21 

0.82 

-2.23 

0.76 

-2.23 

0.00 

0.56 

1.49 

4NBT43 

0.64 

110 

75 

0.22 

0.97 

-0.25 

1.04 

0.32 

0.00 

0.37 

1.03 

4NBT44 

0.69 

90 

58 

0.24 

0.90 

-1.15 

0.81 

-1.43 

0.00 

0.45 

1.34 

4NBT45 

0.64 

99 

73 

0.24 

0.88 

-1.00 

0.82 

-0.92 

0.00 

0.45 

1.21 

4NBT46 

-2.73 

104 

101 

0.60 

1.02 

0.22 

0.57 

-0.30 

0.00 

0.18 

1.01 

4NBT47 

0.39 

109 

81 

0.24 

0.95 

-0.38 

0.80 

-0.87 

0.00 

0.42 

1.12 

4NBT48 

-1.45 

120 

111 

0.36 

0.86 

-0.45 

0.62 

-0.61 

0.00 

0.34 

1.10 

4NBT49 

-1.19 

105 

97 

0.38 

0.99 

0.05 

0.67 

-0.61 

0.00 

0.24 

1.04 

4NBT51 

0.41 

95 

66 

0.24 

0.82 

-1.85 

0.71 

-1.56 

0.00 

0.53 

1.41 

4NBT510 

-1.05 

90 

82 

0.38 

0.97 

-0.02 

0.69 

-0.55 

0.00 

0.29 

1.05 

4NBT511 

0.69 

103 

72 

0.23 

1.00 

0.08 

0.98 

-0.03 

0.00 

0.36 

1.00 

4NBT512 

2.07 

120 

41 

0.21 

0.99 

-0.06 

1.01 

0.09 

0.00 

0.36 

1.00 

4NBT513 

0.79 

90 

50 

0.23 

1.00 

0.03 

0.96 

-0.26 

0.00 

0.38 

1.03 

4NBT514 

2.49 

94 

28 

0.25 

1.08 

0.72 

1.29 

1.72 

0.00 

0.27 

0.78 

4NBT515 

1.82 

91 

40 

0.23 

1.00 

0.01 

0.95 

-0.44 

0.00 

0.40 

1.05 

4NBT52 

2.22 

109 

28 

0.23 

1.15 

1.38 

1.40 

2.29 

0.00 

0.04 

0.66 

4NBT53 

0.79 

202 

135 

0.16 

0.96 

-0.55 

0.98 

-0.17 

0.00 

0.39 

1.09 

4NBT54 

0.49 

110 

78 

0.22 

0.91 

-0.90 

0.80 

-1.30 

0.00 

0.46 

1.21 

4NBT55 

1.32 

89 

46 

0.23 

1.12 

1.49 

1.19 

1.81 

0.00 

0.26 

0.51 

4NBT56 

0.23 

93 

75 

0.28 

0.94 

-0.32 

0.81 

-0.66 

0.00 

0.36 

1.09 

4NBT57 

0.67 

104 

64 

0.22 

1.12 

1.29 

1.24 

1.74 

0.00 

0.28 

0.65 

4NBT58 

0.28 

109 

83 

0.24 

1.16 

1.27 

1.45 

1.71 

0.00 

0.18 

0.70 

4NBT59 

0.83 

117 

75 

0.22 

0.97 

-0.27 

0.91 

-0.48 

0.00 

0.46 

1.08 

4NBT61 

1.70 

104 

50 

0.22 

1.03 

0.41 

1.01 

0.13 

0.00 

0.38 

0.91 

4NBT610 

-0.48 

95 

79 

0.29 

0.86 

-0.78 

0.73 

-0.80 

0.00 

0.43 

1.15 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4NBT611 

0.67 

89 

61 

0.25 

0.80 

-2.07 

0.75 

-1.46 

0.00 

0.55 

1.46 

4NBT612 

-0.11 

103 

85 

0.27 

1.09 

0.60 

1.01 

0.14 

0.00 

0.23 

0.92 

4NBT613 

0.90 

119 

70 

0.20 

1.00 

0.03 

1.04 

0.39 

0.00 

0.37 

0.97 

4NBT614 

-0.09 

89 

65 

0.25 

1.01 

0.10 

0.93 

-0.26 

0.00 

0.33 

1.01 

4NBT615 

1.55 

93 

45 

0.23 

0.93 

-0.88 

0.91 

-0.84 

0.00 

0.47 

1.25 

4NBT616 

2.08 

91 

35 

0.23 

1.15 

1.62 

1.17 

1.34 

0.00 

0.23 

0.58 

4NBT617 

1.32 

106 

46 

0.21 

1.06 

0.83 

1.08 

0.99 

0.00 

0.26 

0.75 

4NBT618 

1.31 

110 

60 

0.21 

0.86 

-2.03 

0.82 

-2.00 

0.00 

0.53 

1.52 

4NBT619 

1.00 

89 

52 

0.23 

0.95 

-0.67 

0.94 

-0.46 

0.00 

0.41 

1.19 

4NBT62 

0.06 

214 

163 

0.17 

0.87 

-1.57 

0.78 

-1.40 

0.00 

0.48 

1.21 

4NBT620 

1.85 

90 

45 

0.23 

1.05 

0.70 

1.04 

0.42 

0.00 

0.33 

0.81 

4NBT621 

0.33 

103 

70 

0.23 

1.02 

0.19 

0.93 

-0.37 

0.00 

0.40 

1.00 

4NBT63 

1.97 

108 

47 

0.22 

1.14 

1.68 

1.14 

1.15 

0.00 

0.31 

0.62 

4NBT64 

1.77 

117 

54 

0.21 

1.31 

3.31 

1.60 

3.94 

0.00 

0.24 

0.14 

4NBT65 

1.39 

94 

47 

0.23 

0.98 

-0.23 

0.97 

-0.18 

0.00 

0.42 

1.07 

4NBT66 

1.29 

89 

50 

0.23 

1.20 

2.31 

1.21 

1.60 

0.00 

0.20 

0.34 

4NBT67 

1.00 

103 

66 

0.22 

0.94 

-0.71 

0.91 

-0.54 

0.00 

0.44 

1.16 

4NBT68 

1.37 

119 

58 

0.20 

0.96 

-0.63 

0.97 

-0.31 

0.00 

0.43 

1.15 

4NBT69 

0.44 

89 

56 

0.24 

1.02 

0.26 

0.97 

-0.12 

0.00 

0.35 

0.97 

4NF11 

0.52 

109 

78 

0.23 

1.00 

-0.02 

0.93 

-0.36 

0.00 

0.34 

1.03 

4NF110 

1.54 

99 

46 

0.22 

1.05 

0.67 

1.11 

0.91 

0.00 

0.35 

0.78 

4NF111 

1.45 

92 

48 

0.23 

1.10 

1.31 

1.14 

1.23 

0.00 

0.28 

0.61 

4NF112 

0.38 

109 

81 

0.24 

1.03 

0.32 

0.97 

-0.09 

0.00 

0.33 

0.96 

4NF113 

-1.98 

122 

116 

0.43 

0.97 

0.02 

0.96 

0.10 

0.00 

0.19 

1.01 

4NF114 

0.62 

93 

55 

0.23 

0.88 

-1.56 

0.82 

-1.40 

0.00 

0.49 

1.44 

4NF115 

0.87 

205 

129 

0.16 

0.99 

-0.13 

0.98 

-0.21 

0.00 

0.38 

1.03 

4NF12 

1.35 

97 

51 

0.22 

1.11 

1.45 

1.12 

1.12 

0.00 

0.27 

0.60 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4NF13 

0.11 

99 

76 

0.25 

0.93 

-0.52 

0.95 

-0.16 

0.00 

0.39 

1.11 

4NF14 

0.62 

116 

69 

0.20 

0.93 

-1.07 

0.91 

-1.05 

0.00 

0.43 

1.29 

4NF15 

1.36 

112 

60 

0.21 

0.91 

-1.26 

0.86 

-1.48 

0.00 

0.49 

1.35 

4NF16 

-0.28 

96 

78 

0.27 

1.05 

0.35 

0.91 

-0.26 

0.00 

0.24 

0.97 

4NF17 

1.70 

110 

58 

0.21 

1.01 

0.14 

0.98 

-0.13 

0.00 

0.38 

0.99 

4NF18 

0.23 

106 

74 

0.23 

1.03 

0.33 

0.99 

-0.03 

0.00 

0.37 

0.95 

4NF19 

0.64 

110 

77 

0.23 

0.97 

-0.23 

0.93 

-0.31 

0.00 

0.40 

1.07 

4NF21 

0.91 

123 

76 

0.21 

1.30 

3.41 

1.34 

2.05 

0.00 

0.23 

0.25 

4NF210 

0.84 

199 

131 

0.16 

0.96 

-0.67 

0.91 

-0.73 

0.00 

0.41 

1.12 

4NF211 

-0.16 

106 

87 

0.27 

0.96 

-0.21 

0.88 

-0.38 

0.00 

0.31 

1.05 

4NF212 

2.57 

96 

26 

0.25 

0.87 

-0.99 

0.88 

-0.60 

0.00 

0.50 

1.19 

4NF213 

0.59 

92 

64 

0.24 

0.88 

-1.14 

0.81 

-1.07 

0.00 

0.47 

1.27 

4NF214 

1.00 

105 

67 

0.22 

1.12 

1.45 

1.10 

0.69 

0.00 

0.28 

0.68 

4NF215 

0.68 

121 

76 

0.20 

0.88 

-1.60 

0.83 

-1.57 

0.00 

0.51 

1.35 

4NF22 

1.44 

93 

39 

0.23 

0.89 

-1.33 

0.90 

-0.88 

0.00 

0.50 

1.33 

4NF23 

2.82 

95 

23 

0.26 

1.31 

2.11 

1.48 

2.15 

0.00 

0.05 

0.54 

4NF24 

1.30 

91 

50 

0.23 

1.08 

1.02 

1.15 

1.29 

0.00 

0.28 

0.66 

4NF25 

-0.43 

114 

90 

0.24 

0.91 

-0.69 

0.84 

-0.83 

0.00 

0.41 

1.13 

4NF26 

0.49 

110 

78 

0.22 

1.00 

0.07 

0.93 

-0.40 

0.00 

0.36 

1.02 

4NF27 

-0.17 

92 

73 

0.27 

1.03 

0.25 

1.03 

0.19 

0.00 

0.24 

0.95 

4NF28 

1.19 

106 

67 

0.22 

1.00 

-0.01 

0.94 

-0.43 

0.00 

0.37 

1.04 

4NF29 

0.09 

104 

75 

0.24 

0.79 

-1.95 

0.66 

-2.06 

0.00 

0.59 

1.39 

4NF31 

2.34 

109 

40 

0.22 

1.03 

0.36 

1.05 

0.38 

0.00 

0.40 

0.92 

4NF310 

0.65 

121 

81 

0.21 

0.80 

-2.38 

0.66 

-2.08 

0.00 

0.57 

1.47 

4NF311 

0.95 

105 

67 

0.22 

1.02 

0.26 

0.99 

-0.05 

0.00 

0.34 

0.96 

4NF312 

2.10 

96 

34 

0.23 

0.87 

-1.34 

0.88 

-0.80 

0.00 

0.51 

1.27 

4NF313 

2.42 

92 

30 

0.24 

0.79 

-2.09 

0.76 

-1.69 

0.00 

0.59 

1.42 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4NF314 

1.69 

214 

85 

0.15 

1.12 

1.93 

1.15 

1.86 

0.00 

0.27 

0.66 

4NF315 

1.72 

103 

51 

0.22 

1.16 

1.96 

1.21 

1.73 

0.00 

0.27 

0.48 

4NF32 

0.68 

121 

76 

0.20 

0.98 

-0.21 

0.96 

-0.30 

0.00 

0.40 

1.06 

4NF33 

-0.27 

91 

69 

0.26 

1.03 

0.27 

1.00 

0.06 

0.00 

0.28 

0.96 

4NF34 

1.59 

95 

45 

0.22 

0.94 

-0.70 

0.96 

-0.33 

0.00 

0.44 

1.17 

4NF35 

-0.07 

91 

73 

0.28 

0.93 

-0.40 

0.80 

-0.73 

0.00 

0.38 

1.11 

4NF36 

0.05 

113 

80 

0.22 

0.84 

-1.70 

0.77 

-1.78 

0.00 

0.52 

1.35 

4NF37 

-0.20 

110 

90 

0.26 

1.03 

0.22 

0.98 

-0.02 

0.00 

0.28 

0.98 

4NF38 

-0.65 

91 

78 

0.31 

0.96 

-0.14 

0.84 

-0.41 

0.00 

0.28 

1.05 

4NF39 

0.46 

102 

78 

0.25 

0.79 

-1.73 

0.64 

-1.84 

0.00 

0.55 

1.34 

4NF41 

1.29 

104 

51 

0.22 

1.26 

3.05 

1.39 

3.25 

0.00 

0.16 

0.14 

4NF410 

2.92 

109 

29 

0.24 

1.13 

1.05 

1.41 

1.94 

0.00 

0.27 

0.75 

4NF411 

0.28 

120 

88 

0.23 

1.00 

0.02 

0.91 

-0.32 

0.00 

0.40 

1.02 

4NF412 

1.51 

105 

55 

0.21 

1.31 

3.95 

1.37 

3.17 

0.00 

0.13 

-0.17 

4NF413 

1.20 

95 

51 

0.22 

0.97 

-0.36 

0.98 

-0.13 

0.00 

0.42 

1.09 

4NF414 

2.40 

90 

30 

0.24 

1.05 

0.47 

1.10 

0.71 

0.00 

0.34 

0.87 

4NF415 

1.34 

103 

59 

0.22 

1.02 

0.29 

1.09 

0.69 

0.00 

0.38 

0.92 

4NF416 

1.31 

120 

60 

0.20 

0.87 

-1.96 

0.84 

-1.88 

0.00 

0.53 

1.48 

4NF417 

0.13 

90 

62 

0.24 

0.93 

-0.74 

0.82 

-0.94 

0.00 

0.42 

1.21 

4NF418 

1.67 

190 

88 

0.16 

0.88 

-2.17 

0.87 

-1.81 

0.00 

0.51 

1.39 

4NF419 

2.37 

94 

30 

0.24 

1.05 

0.44 

1.12 

0.85 

0.00 

0.33 

0.87 

4NF42 

0.65 

91 

62 

0.24 

0.93 

-0.71 

1.04 

0.28 

0.00 

0.39 

1.12 

4NF420 

1.61 

111 

42 

0.21 

1.07 

0.99 

1.13 

1.29 

0.00 

0.22 

0.72 

4NF43 

0.78 

110 

72 

0.22 

1.07 

0.81 

1.18 

1.34 

0.00 

0.27 

0.78 

4NF44 

1.69 

89 

39 

0.23 

1.29 

3.03 

1.33 

2.86 

0.00 

0.13 

0.10 

4NF45 

2.87 

98 

29 

0.24 

1.10 

0.87 

1.10 

0.69 

0.00 

0.28 

0.82 

4NF46 

1.62 

104 

44 

0.22 

1.06 

0.72 

1.09 

0.75 

0.00 

0.35 

0.82 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4NF47 

0.76 

109 

74 

0.22 

0.89 

-1.14 

0.78 

-1.29 

0.00 

0.49 

1.27 

4NF48 

1.05 

119 

71 

0.21 

0.96 

-0.49 

0.99 

-0.04 

0.00 

0.46 

1.08 

4NF49 

2.06 

105 

43 

0.22 

0.89 

-1.31 

0.91 

-0.76 

0.00 

0.49 

1.28 

4NF51 

2.03 

95 

35 

0.23 

0.86 

-1.53 

0.78 

-1.61 

0.00 

0.54 

1.37 

4NF510 

3.67 

90 

13 

0.32 

0.93 

-0.27 

0.90 

-0.18 

0.00 

0.40 

1.06 

4NF511 

-0.74 

103 

92 

0.33 

0.86 

-0.54 

0.56 

-1.06 

0.00 

0.40 

1.14 

4NF512 

-0.91 

120 

105 

0.29 

0.88 

-0.59 

0.66 

-1.15 

0.00 

0.42 

1.13 

4NF513 

2.13 

90 

26 

0.25 

0.93 

-0.55 

0.91 

-0.51 

0.00 

0.47 

1.13 

4NF514 

2.68 

94 

25 

0.25 

0.94 

-0.48 

1.10 

0.57 

0.00 

0.41 

1.05 

4NF515 

3.42 

91 

15 

0.30 

1.05 

0.32 

1.03 

0.22 

0.00 

0.29 

0.96 

4NF516 

-0.97 

225 

198 

0.21 

1.01 

0.14 

1.05 

0.30 

0.00 

0.22 

0.98 

4NF517 

-0.10 

109 

80 

0.23 

1.03 

0.28 

0.98 

-0.08 

0.00 

0.29 

0.97 

4NF518 

-0.20 

110 

90 

0.26 

0.98 

-0.10 

0.91 

-0.30 

0.00 

0.34 

1.04 

4NF519 

2.59 

89 

24 

0.26 

1.08 

0.66 

1.16 

0.86 

0.00 

0.32 

0.85 

4NF52 

3.29 

93 

21 

0.27 

1.07 

0.50 

1.60 

2.48 

0.00 

0.19 

0.78 

4NF520 

-0.78 

104 

88 

0.29 

0.92 

-0.38 

0.87 

-0.34 

0.00 

0.38 

1.07 

4NF53 

2.59 

109 

35 

0.23 

1.07 

0.70 

1.26 

1.57 

0.00 

0.34 

0.80 

4NF54 

-0.53 

117 

99 

0.28 

1.05 

0.33 

0.92 

-0.12 

0.00 

0.30 

0.97 

4NF55 

2.83 

104 

28 

0.25 

0.92 

-0.64 

0.89 

-0.55 

0.00 

0.49 

1.13 

4NF56 

2.48 

94 

27 

0.25 

0.93 

-0.54 

1.20 

1.10 

0.00 

0.42 

1.04 

4NF57 

-1.19 

89 

82 

0.41 

0.91 

-0.20 

0.61 

-0.67 

0.00 

0.33 

1.09 

4NF58 

0.80 

103 

70 

0.23 

0.98 

-0.15 

0.84 

-0.90 

0.00 

0.41 

1.11 

4NF59 

1.45 

119 

56 

0.20 

0.99 

-0.19 

0.98 

-0.21 

0.00 

0.40 

1.06 

4NF71 

0.71 

89 

51 

0.23 

0.96 

-0.47 

1.11 

0.87 

0.00 

0.39 

1.06 

4NF710 

-0.39 

92 

77 

0.29 

0.84 

-0.92 

0.62 

-1.29 

0.00 

0.46 

1.20 

4NF711 

0.08 

91 

71 

0.27 

1.24 

1.65 

1.40 

1.56 

0.00 

0.03 

0.62 

4NF712 

-0.82 

106 

89 

0.28 

1.02 

0.16 

1.18 

0.78 

0.00 

0.21 

0.95 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


221 

Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

4NF713 

-0.76 

110 

97 

0.31 

0.89 

-0.49 

0.69 

-0.92 

0.00 

0.40 

1.11 

4NF714 

2.39 

89 

27 

0.25 

0.75 

-2.22 

0.67 

-2.32 

0.00 

0.64 

1.46 

4NF715 

2.32 

90 

36 

0.23 

1.06 

0.74 

1.06 

0.56 

0.00 

0.32 

0.82 

4NF72 

-0.86 

103 

88 

0.30 

0.98 

-0.06 

0.85 

-0.35 

0.00 

0.35 

1.04 

4NF73 

0.82 

108 

72 

0.22 

0.95 

-0.52 

0.86 

-0.80 

0.00 

0.44 

1.15 

4NF74 

-0.68 

117 

101 

0.29 

1.05 

0.35 

1.14 

0.48 

0.00 

0.26 

0.93 

4NF75 

1.55 

91 

44 

0.23 

0.94 

-0.68 

0.95 

-0.42 

0.00 

0.45 

1.17 

4NF76 

-0.59 

91 

79 

0.32 

0.90 

-0.38 

0.66 

-0.95 

0.00 

0.38 

1.11 

4NF77 

0.21 

214 

158 

0.17 

0.97 

-0.35 

0.95 

-0.30 

0.00 

0.41 

1.06 

4NF78 

0.72 

104 

59 

0.21 

1.00 

0.07 

1.01 

0.19 

0.00 

0.33 

0.97 

4NF79 

-0.34 

110 

92 

0.27 

1.09 

0.57 

1.14 

0.57 

0.00 

0.21 

0.91 

40A11 

1.11 

108 

65 

0.21 

1.08 

0.99 

1.06 

0.50 

0.00 

0.31 

0.77 

4OA110 

-0.33 

96 

78 

0.28 

0.89 

-0.68 

0.77 

-0.71 

0.00 

0.41 

1.14 

40A111 

0.07 

92 

72 

0.27 

0.99 

0.00 

0.88 

-0.41 

0.00 

0.33 

1.03 

40A112 

-0.32 

106 

90 

0.28 

0.88 

-0.65 

0.79 

-0.57 

0.00 

0.38 

1.12 

40A113 

1.63 

121 

52 

0.20 

1.19 

2.46 

1.28 

2.76 

0.00 

0.16 

0.33 

40A114 

-0.90 

93 

79 

0.30 

1.03 

0.23 

1.37 

1.08 

0.00 

0.17 

0.92 

40A115 

-0.36 

96 

80 

0.29 

1.06 

0.41 

1.23 

0.82 

0.00 

0.18 

0.90 

40A116 

-0.64 

93 

81 

0.32 

0.90 

-0.40 

0.70 

-0.80 

0.00 

0.37 

1.10 

40A117 

0.13 

114 

79 

0.21 

0.88 

-1.30 

0.84 

-1.32 

0.00 

0.47 

1.28 

40A118 

-1.48 

110 

103 

0.40 

0.89 

-0.26 

0.56 

-0.86 

0.00 

0.35 

1.09 

40A119 

-0.76 

204 

179 

0.22 

0.94 

-0.35 

0.84 

-0.55 

0.00 

0.30 

1.06 

40A12 

0.46 

92 

63 

0.24 

0.97 

-0.32 

0.94 

-0.35 

0.00 

0.35 

1.08 

4OA120 

0.37 

108 

84 

0.25 

0.94 

-0.41 

0.87 

-0.53 

0.00 

0.38 

1.09 

40A121 

0.77 

104 

62 

0.22 

0.85 

-1.72 

0.79 

-1.83 

0.00 

0.56 

1.41 

40A122 

1.17 

110 

66 

0.21 

0.94 

-0.71 

0.87 

-0.89 

0.00 

0.47 

1.19 

40A123 

2.14 

122 

47 

0.21 

1.46 

4.29 

1.86 

4.80 

0.00 

0.14 

-0.05 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40A124 

1.01 

106 

66 

0.22 

0.96 

-0.50 

0.93 

-0.49 

0.00 

0.40 

1.13 

40A125 

0.21 

96 

70 

0.25 

1.09 

0.79 

1.18 

0.86 

0.00 

0.25 

0.82 

40A13 

1.45 

92 

48 

0.23 

1.06 

0.82 

1.05 

0.47 

0.00 

0.33 

0.78 

40A14 

0.19 

105 

82 

0.25 

0.89 

-0.88 

0.88 

-0.39 

0.00 

0.42 

1.16 

40A15 

-0.14 

121 

94 

0.23 

1.04 

0.37 

1.08 

0.45 

0.00 

0.28 

0.94 

40A16 

-0.35 

92 

71 

0.26 

0.91 

-0.65 

0.79 

-0.83 

0.00 

0.40 

1.16 

40A17 

1.05 

200 

123 

0.16 

1.02 

0.38 

1.00 

-0.01 

0.00 

0.35 

0.95 

40A18 

0.02 

95 

74 

0.26 

0.83 

-1.29 

0.70 

-1.32 

0.00 

0.49 

1.27 

40A19 

0.59 

91 

63 

0.24 

1.09 

0.91 

1.09 

0.54 

0.00 

0.25 

0.80 

40A21 

-1.64 

114 

105 

0.36 

0.85 

-0.49 

0.48 

-1.56 

0.00 

0.45 

1.13 

4OA210 

1.31 

110 

60 

0.21 

0.97 

-0.37 

0.94 

-0.56 

0.00 

0.41 

1.12 

40A22 

2.11 

92 

32 

0.24 

1.01 

0.10 

1.07 

0.57 

0.00 

0.38 

0.95 

40A23 

0.82 

104 

73 

0.23 

1.01 

0.14 

1.03 

0.24 

0.00 

0.32 

0.96 

40A24 

-0.14 

104 

79 

0.25 

0.97 

-0.22 

0.99 

0.03 

0.00 

0.39 

1.04 

40A25 

-0.32 

109 

92 

0.28 

0.77 

-1.42 

0.51 

-1.67 

0.00 

0.52 

1.27 

40A26 

-0.73 

120 

104 

0.29 

0.87 

-0.65 

0.59 

-1.09 

0.00 

0.41 

1.14 

40A27 

-0.06 

105 

85 

0.26 

0.88 

-0.78 

0.70 

-1.18 

0.00 

0.40 

1.18 

40A28 

0.33 

96 

68 

0.24 

1.03 

0.33 

0.99 

0.03 

0.00 

0.33 

0.95 

40A29 

0.98 

92 

57 

0.23 

0.85 

-1.84 

0.83 

-1.20 

0.00 

0.51 

1.44 

40A31 

2.01 

103 

45 

0.22 

0.96 

-0.40 

0.93 

-0.57 

0.00 

0.46 

1.11 

4OA310 

-0.14 

121 

94 

0.23 

1.01 

0.08 

0.86 

-0.69 

0.00 

0.35 

1.03 

40A311 

1.53 

90 

36 

0.24 

1.11 

1.23 

1.21 

1.62 

0.00 

0.27 

0.63 

40A312 

1.88 

94 

39 

0.23 

1.10 

1.09 

1.12 

1.04 

0.00 

0.30 

0.71 

40A313 

1.56 

91 

45 

0.23 

0.83 

-2.39 

0.80 

-2.03 

0.00 

0.56 

1.65 

40A314 

1.69 

111 

40 

0.21 

0.95 

-0.69 

0.95 

-0.49 

0.00 

0.39 

1.16 

40A315 

1.48 

110 

56 

0.21 

1.11 

1.57 

1.18 

1.89 

0.00 

0.25 

0.53 

40A316 

0.93 

91 

54 

0.23 

0.82 

-2.47 

0.75 

-2.28 

0.00 

0.54 

1.67 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


223 

Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40A317 

1.43 

99 

58 

0.22 

0.90 

-1.35 

0.88 

-0.99 

0.00 

0.47 

1.34 

40A318 

0.42 

104 

69 

0.23 

0.92 

-0.76 

0.85 

-0.99 

0.00 

0.48 

1.19 

40A319 

-0.03 

109 

88 

0.26 

0.89 

-0.73 

0.68 

-1.17 

0.00 

0.44 

1.17 

40A32 

0.85 

120 

76 

0.21 

0.94 

-0.75 

0.92 

-0.44 

0.00 

0.47 

1.14 

4OA320 

0.49 

199 

144 

0.17 

1.23 

2.86 

2.44 

7.26 

0.00 

-0.01 

0.27 

40A33 

1.14 

105 

63 

0.22 

1.04 

0.56 

0.99 

-0.04 

0.00 

0.34 

0.90 

40A34 

0.57 

95 

63 

0.23 

1.01 

0.09 

0.95 

-0.22 

0.00 

0.37 

1.00 

40A35 

0.87 

90 

58 

0.24 

0.85 

-1.67 

0.78 

-1.50 

0.00 

0.52 

1.42 

40A36 

2.25 

103 

40 

0.22 

1.02 

0.20 

0.99 

0.00 

0.00 

0.42 

0.97 

40A37 

-0.41 

120 

98 

0.25 

0.96 

-0.21 

0.79 

-0.93 

0.00 

0.38 

1.08 

40  A3  8 

-0.39 

90 

70 

0.27 

1.05 

0.41 

0.97 

-0.05 

0.00 

0.26 

0.94 

40A39 

0.04 

94 

73 

0.26 

0.93 

-0.50 

0.80 

-0.83 

0.00 

0.39 

1.13 

40A41 

0.54 

91 

64 

0.24 

0.97 

-0.23 

1.07 

0.43 

0.00 

0.35 

1.03 

4OA410 

-2.27 

111 

106 

0.46 

0.97 

0.06 

0.68 

-0.46 

0.00 

0.23 

1.03 

40A411 

-1.48 

110 

103 

0.40 

0.82 

-0.50 

0.43 

-1.27 

0.00 

0.43 

1.14 

40A412 

-0.41 

89 

74 

0.29 

0.95 

-0.25 

0.78 

-0.71 

0.00 

0.32 

1.09 

40A413 

0.71 

95 

69 

0.24 

0.97 

-0.22 

0.94 

-0.28 

0.00 

0.36 

1.06 

40A414 

0.77 

104 

62 

0.22 

0.83 

-2.06 

0.77 

-2.03 

0.00 

0.58 

1.47 

40A415 

0.39 

109 

81 

0.24 

0.76 

-2.33 

0.59 

-2.05 

0.00 

0.58 

1.43 

40A416 

-0.41 

119 

99 

0.26 

0.85 

-1.01 

0.59 

-1.32 

0.00 

0.46 

1.20 

40A417 

0.18 

190 

144 

0.18 

0.88 

-1.44 

0.71 

-1.99 

0.00 

0.47 

1.24 

40A418 

1.04 

105 

65 

0.22 

1.08 

0.98 

1.10 

0.80 

0.00 

0.30 

0.75 

40A419 

1.66 

95 

42 

0.23 

1.12 

1.47 

1.13 

1.03 

0.00 

0.29 

0.62 

40A42 

0.33 

90 

67 

0.26 

0.79 

-1.76 

0.64 

-1.80 

0.00 

0.55 

1.39 

4OA420 

2.46 

103 

36 

0.23 

1.14 

1.29 

1.18 

1.20 

0.00 

0.31 

0.72 

40A421 

2.29 

119 

36 

0.21 

1.10 

1.04 

1.14 

1.02 

0.00 

0.24 

0.78 

40A422 

0.36 

90 

58 

0.24 

0.99 

-0.10 

0.99 

-0.03 

0.00 

0.36 

1.02 
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Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40A423 

0.72 

93 

61 

0.23 

0.88 

-1.33 

0.84 

-1.06 

0.00 

0.48 

1.32 

40A424 

1.40 

91 

48 

0.23 

1.16 

2.08 

1.32 

2.69 

0.00 

0.19 

0.31 

40A425 

1.81 

108 

36 

0.22 

1.28 

3.09 

1.41 

3.13 

0.00 

-0.07 

0.19 

40A43 

1.88 

214 

89 

0.15 

1.05 

0.78 

1.07 

0.82 

0.00 

0.38 

0.86 

40A44 

-0.01 

110 

87 

0.25 

0.82 

-1.36 

0.69 

-1.51 

0.00 

0.52 

1.25 

40A45 

1.42 

89 

44 

0.23 

0.94 

-0.68 

0.93 

-0.70 

0.00 

0.44 

1.21 

40A46 

0.91 

91 

63 

0.24 

1.07 

0.71 

1.49 

2.48 

0.00 

0.20 

0.71 

40A47 

0.96 

104 

58 

0.22 

0.97 

-0.39 

0.91 

-0.79 

0.00 

0.46 

1.13 

40A48 

1.69 

109 

54 

0.21 

1.15 

1.88 

1.17 

1.41 

0.00 

0.30 

0.54 

40A49 

-0.31 

117 

96 

0.26 

0.91 

-0.58 

0.67 

-1.04 

0.00 

0.43 

1.14 

40A51 

0.38 

104 

77 

0.24 

1.03 

0.26 

0.90 

-0.44 

0.00 

0.32 

1.00 

4OA510 

1.29 

94 

49 

0.23 

1.20 

2.50 

1.27 

2.01 

0.00 

0.21 

0.26 

40A511 

0.90 

89 

57 

0.24 

0.92 

-0.91 

0.82 

-1.18 

0.00 

0.47 

1.27 

40A512 

0.10 

103 

82 

0.26 

1.03 

0.24 

0.99 

0.04 

0.00 

0.29 

0.96 

40A513 

-0.22 

119 

94 

0.24 

0.84 

-1.26 

0.70 

-1.56 

0.00 

0.51 

1.23 

40A514 

-1.15 

89 

78 

0.33 

1.11 

0.55 

1.16 

0.51 

0.00 

0.11 

0.89 

40A515 

0.64 

91 

61 

0.24 

0.98 

-0.20 

0.99 

0.03 

0.00 

0.37 

1.03 

40A516 

1.66 

91 

43 

0.23 

0.85 

-2.06 

0.82 

-1.78 

0.00 

0.54 

1.56 

40A517 

1.75 

105 

36 

0.22 

1.04 

0.55 

1.16 

1.35 

0.00 

0.24 

0.81 

40A518 

1.05 

110 

66 

0.21 

0.99 

-0.12 

1.11 

1.04 

0.00 

0.36 

0.95 

40A519 

2.09 

89 

32 

0.24 

1.15 

1.39 

1.20 

1.48 

0.00 

0.26 

0.64 

40A52 

-0.48 

89 

79 

0.35 

0.92 

-0.26 

0.62 

-0.93 

0.00 

0.36 

1.10 

4OA520 

1.41 

103 

48 

0.22 

1.02 

0.24 

1.03 

0.29 

0.00 

0.40 

0.95 

40A53 

1.20 

108 

64 

0.22 

0.96 

-0.46 

0.89 

-0.80 

0.00 

0.45 

1.15 

40A54 

1.53 

224 

116 

0.15 

1.03 

0.61 

1.02 

0.25 

0.00 

0.42 

0.91 

40A55 

0.89 

89 

54 

0.23 

0.81 

-2.55 

0.77 

-2.01 

0.00 

0.53 

1.66 

40A56 

2.11 

224 

73 

0.15 

1.04 

0.68 

1.13 

1.35 

0.00 

0.29 

0.87 
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Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

40A57 

1.55 

89 

50 

0.23 

0.95 

-0.61 

0.92 

-0.67 

0.00 

0.42 

1.20 

40A58 

2.87 

103 

21 

0.26 

0.95 

-0.29 

1.08 

0.38 

0.00 

0.37 

1.03 

40A59 

2.18 

116 

45 

0.22 

0.84 

-1.67 

0.86 

-0.95 

0.00 

0.58 

1.30 
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Appendix  E:  Distractor  Statistics 


Appendix  E:  Distractor  Statistics  for  Full  CCSS  Item  Bank 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40001 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40001 

A 

1 

55 

96 

0.85 

0.19 

0.51 

0.55 

40001 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40001 

C 

0 

1 

2 

-3.03 

0.00 

0.09 

-0.31 

40001 

D 

0 

1 

2 

-4.95 

0.00 

0.01 

-0.47 

40002 

* 

-1 

4841 

99 

1.00 

0.02 

0.00 

0.00 

40002 

A 

1 

42 

98 

1.06 

0.22 

0.77 

0.39 

40002 

B 

0 

1 

2 

-2.89 

0.00 

0.06 

-0.39 

40002 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40002 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40003 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40003 

A 

1 

28 

50 

1.15 

0.26 

1.10 

0.34 

40003 

B 

0 

20 

36 

0.69 

0.23 

1.75 

0.04 

40003 

C 

0 

3 

5 

-0.45 

0.75 

0.58 

-0.15 

40003 

D 

0 

5 

9 

-2.23 

1.04 

0.21 

-0.55 

40004 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

40004 

A 

1 

53 

93 

0.67 

0.19 

0.88 

0.23 

40004 

B 

0 

3 

5 

0.19 

0.70 

1.93 

-0.06 

40004 

C 

0 

1 

2 

-3.26 

0.00 

0.04 

-0.35 

40004 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40005 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40005 

A 

1 

53 

96 

0.84 

0.20 

1.01 

0.49 

40005 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40005 

C 

0 

1 

2 

-1.23 

0.00 

0.31 

-0.15 

40005 

D 

0 

1 

2 

-6.10 

0.00 

0.00 

-0.53 

40006 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.02 

40006 

A 

1 

9 

18 

1.70 

0.43 

1.02 

0.40 

40006 

B 

0 

21 

42 

0.38 

0.17 

0.66 

-0.27 

40006 

C 

0 

17 

34 

0.87 

0.24 

1.33 

0.08 

40006 

D 

0 

3 

6 

-0.32 

1.09 

0.50 

-0.24 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40007 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.02 

40007 

A 

1 

58 

97 

0.81 

0.15 

1.07 

0.08 

40007 

B 

0 

1 

2 

0.31 

0.00 

1.13 

-0.06 

40007 

C 

0 

1 

2 

0.30 

0.00 

1.12 

-0.06 

40007 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40008 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.04 

40008 

A 

1 

36 

57 

0.93 

0.25 

1.60 

0.33 

40008 

B 

0 

3 

5 

-0.50 

0.55 

0.56 

-0.17 

40008 

C 

0 

17 

27 

0.02 

0.28 

1.13 

-0.23 

40008 

D 

0 

7 

11 

0.23 

0.32 

1.19 

-0.08 

40009 

* 

-1 

4828 

99 

1.01 

0.02 

0.00 

0.05 

40009 

A 

1 

37 

66 

1.06 

0.17 

0.72 

0.60 

40009 

B 

0 

4 

7 

-1.67 

1.38 

0.52 

-0.34 

40009 

C 

0 

4 

7 

-0.49 

0.38 

0.55 

-0.14 

40009 

D 

0 

11 

20 

-0.97 

0.56 

0.56 

-0.40 

40010 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40010 

A 

1 

39 

71 

1.27 

0.22 

1.06 

0.36 

40010 

B 

0 

4 

7 

0.05 

0.29 

0.64 

-0.18 

40010 

C 

0 

7 

13 

0.23 

0.64 

1.82 

-0.20 

40010 

D 

0 

5 

9 

0.21 

0.28 

0.76 

-0.17 

40011 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40011 

A 

1 

49 

89 

0.78 

0.20 

0.97 

0.33 

40011 

B 

0 

3 

5 

-0.67 

0.41 

0.59 

-0.22 

40011 

C 

0 

3 

5 

-0.73 

0.19 

0.48 

-0.23 

40011 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40012 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.00 

40012 

A 

1 

49 

75 

1.21 

0.18 

0.99 

0.36 

40012 

B 

0 

12 

18 

0.36 

0.37 

1.33 

-0.21 

40012 

C 

0 

2 

3 

-0.55 

0.13 

0.32 

-0.21 

40012 

D 

0 

2 

3 

-0.58 

0.27 

0.32 

-0.21 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40013 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

40013 

A 

1 

45 

88 

1.22 

0.23 

1.18 

0.39 

40013 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40013 

C 

0 

3 

6 

-0.73 

0.96 

0.70 

-0.26 

40013 

D 

0 

3 

6 

-0.81 

0.22 

0.38 

-0.27 

40014 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40014 

A 

1 

48 

86 

0.71 

0.16 

0.92 

0.31 

40014 

B 

0 

2 

4 

-1.25 

0.48 

0.27 

-0.30 

40014 

C 

0 

4 

7 

0.32 

0.47 

1.59 

-0.06 

40014 

D 

0 

2 

4 

-0.59 

0.51 

0.52 

-0.19 

40015 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

-0.01 

40015 

A 

1 

35 

74 

1.36 

0.17 

1.10 

0.39 

40015 

B 

0 

6 

13 

-0.04 

0.40 

0.57 

-0.42 

40015 

C 

0 

5 

11 

1.14 

0.25 

1.42 

0.01 

40015 

D 

0 

1 

2 

-0.52 

0.00 

0.24 

-0.23 

40016 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40016 

A 

1 

44 

80 

1.32 

0.18 

0.87 

0.48 

40016 

B 

0 

2 

4 

0.88 

0.63 

1.51 

-0.01 

40016 

C 

0 

5 

9 

-0.03 

0.35 

0.65 

-0.19 

40016 

D 

0 

4 

7 

-1.99 

1.49 

0.46 

-0.52 

40017 

* 

-1 

1822 

37 

1.37 

0.03 

0.00 

0.22 

40017 

A 

1 

2507 

82 

1.06 

0.02 

0.92 

0.45 

40017 

B 

0 

239 

8 

-0.33 

0.06 

0.71 

-0.25 

40017 

C 

0 

120 

4 

-0.20 

0.09 

1.09 

-0.15 

40017 

D 

0 

196 

6 

-0.80 

0.10 

0.57 

-0.31 

40018 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.02 

40018 

A 

1 

60 

92 

0.83 

0.16 

1.07 

0.14 

40018 

B 

0 

2 

3 

0.73 

0.30 

1.76 

-0.01 

40018 

C 

0 

1 

2 

2.15 

0.00 

6.99 

0.14 

40018 

D 

0 

2 

3 

-1.34 

0.02 

0.21 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40019 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.02 

40019 

A 

1 

43 

86 

0.90 

0.13 

0.92 

0.40 

40019 

B 

0 

6 

12 

-0.06 

0.37 

0.84 

-0.32 

40019 

C 

0 

1 

2 

-0.87 

0.00 

0.27 

-0.25 

40019 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40020 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

40020 

A 

1 

42 

74 

0.94 

0.16 

0.81 

0.53 

40020 

B 

0 

2 

4 

-0.31 

0.12 

0.54 

-0.10 

40020 

C 

0 

2 

4 

-0.23 

0.08 

0.58 

-0.09 

40020 

D 

0 

11 

19 

-1.00 

0.62 

0.86 

-0.50 

40021 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40021 

A 

1 

49 

89 

1.04 

0.18 

0.90 

0.36 

40021 

B 

0 

6 

11 

-0.41 

0.31 

0.56 

-0.36 

40021 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40021 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40022 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.01 

40022 

A 

1 

45 

78 

1.05 

0.23 

1.46 

0.28 

40022 

B 

0 

4 

7 

0.36 

0.08 

0.99 

-0.09 

40022 

C 

0 

3 

5 

0.21 

0.48 

1.03 

-0.10 

40022 

D 

0 

6 

10 

-0.19 

0.50 

1.17 

-0.24 

40023 

* 

-1 

4620 

95 

0.97 

0.02 

0.00 

-0.08 

40023 

A 

1 

240 

91 

1.58 

0.07 

0.91 

0.42 

40023 

B 

0 

5 

2 

0.06 

0.17 

0.41 

-0.18 

40023 

C 

0 

12 

5 

-0.04 

0.15 

0.40 

-0.30 

40023 

D 

0 

7 

3 

0.06 

0.41 

0.72 

-0.21 

40024 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

40024 

A 

1 

45 

85 

0.92 

0.20 

0.91 

0.34 

40024 

B 

0 

1 

2 

-0.12 

0.00 

0.73 

-0.08 

40024 

C 

0 

4 

8 

0.47 

0.56 

2.34 

-0.05 

40024 

D 

0 

3 

6 

-1.64 

0.27 

0.17 

-0.42 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40025 

* 

-1 

4818 

99 

1.00 

0.02 

0.00 

-0.01 

40025 

A 

1 

54 

82 

1.37 

0.13 

0.81 

0.49 

40025 

B 

0 

3 

5 

0.67 

0.42 

1.11 

-0.09 

40025 

C 

0 

3 

5 

-0.09 

0.65 

0.59 

-0.23 

40025 

D 

0 

6 

9 

-0.41 

0.37 

0.48 

-0.43 

40026 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40026 

A 

1 

41 

73 

0.96 

0.17 

1.04 

0.42 

40026 

B 

0 

5 

9 

-0.04 

0.59 

1.15 

-0.19 

40026 

C 

0 

2 

4 

-0.03 

0.38 

0.69 

-0.12 

40026 

D 

0 

8 

14 

-0.22 

0.35 

0.80 

-0.32 

40027 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.01 

40027 

A 

1 

52 

83 

1.13 

0.14 

0.83 

0.52 

40027 

B 

0 

2 

3 

-0.54 

2.11 

1.52 

-0.21 

40027 

C 

0 

8 

13 

-0.42 

0.19 

0.47 

-0.41 

40027 

D 

0 

1 

2 

-0.75 

0.00 

0.29 

-0.17 

40028 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.00 

40028 

A 

1 

22 

45 

1.63 

0.25 

0.76 

0.54 

40028 

B 

0 

10 

20 

0.05 

0.19 

0.51 

-0.44 

40028 

C 

0 

11 

22 

0.72 

0.15 

0.93 

-0.14 

40028 

D 

0 

6 

12 

0.70 

0.19 

0.88 

-0.10 

40029 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

-0.01 

40029 

A 

1 

33 

63 

1.56 

0.27 

1.33 

0.34 

40029 

B 

0 

11 

21 

0.24 

0.28 

0.77 

-0.33 

40029 

C 

0 

3 

6 

-0.04 

0.35 

0.46 

-0.20 

40029 

D 

0 

5 

10 

1.43 

0.62 

4.80 

0.05 

40030 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.02 

40030 

A 

1 

46 

78 

1.12 

0.16 

0.88 

0.46 

40030 

B 

0 

7 

12 

-0.13 

0.44 

0.89 

-0.22 

40030 

C 

0 

2 

3 

0.97 

1.03 

2.43 

0.03 

40030 

D 

0 

4 

7 

-1.95 

1.44 

0.44 

-0.49 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40031 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40031 

A 

1 

41 

73 

0.98 

0.18 

0.94 

0.56 

40031 

B 

0 

7 

13 

-0.07 

0.12 

0.75 

-0.13 

40031 

C 

0 

1 

2 

-1.87 

0.00 

0.12 

-0.21 

40031 

D 

0 

7 

13 

-1.67 

0.79 

0.42 

-0.53 

40032 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40032 

A 

1 

43 

77 

1.01 

0.20 

0.88 

0.50 

40032 

B 

0 

5 

9 

-0.77 

0.21 

0.37 

-0.27 

40032 

C 

0 

3 

5 

-0.29 

0.15 

0.56 

-0.13 

40032 

D 

0 

5 

9 

-1.27 

1.22 

0.75 

-0.37 

40033 

* 

-1 

4619 

95 

0.99 

0.02 

0.00 

-0.04 

40033 

A 

1 

243 

92 

1.31 

0.07 

1.03 

0.29 

40033 

B 

0 

7 

3 

0.22 

0.22 

0.64 

-0.15 

40033 

C 

0 

13 

5 

0.29 

0.16 

0.69 

-0.20 

40033 

D 

0 

2 

1 

-0.63 

0.47 

0.27 

-0.15 

40034 

* 

-1 

4814 

99 

1.00 

0.02 

0.00 

0.01 

40034 

A 

1 

33 

47 

1.51 

0.14 

0.73 

0.52 

40034 

B 

0 

9 

13 

0.06 

0.34 

0.57 

-0.30 

40034 

C 

0 

19 

27 

0.82 

0.26 

1.64 

-0.05 

40034 

D 

0 

9 

13 

-0.29 

0.18 

0.34 

-0.42 

40035 

* 

-1 

4817 

99 

1.00 

0.02 

0.00 

0.01 

40035 

A 

1 

38 

57 

1.31 

0.21 

1.61 

0.35 

40035 

B 

0 

9 

13 

0.29 

0.38 

0.89 

-0.20 

40035 

C 

0 

12 

18 

0.58 

0.22 

0.93 

-0.13 

40035 

D 

0 

8 

12 

0.31 

0.43 

0.98 

-0.18 

40036 

* 

-1 

4816 

99 

1.00 

0.02 

0.00 

0.03 

40036 

A 

1 

49 

72 

1.02 

0.17 

0.88 

0.49 

40036 

B 

0 

6 

9 

-0.11 

0.40 

0.86 

-0.19 

40036 

C 

0 

10 

15 

-0.32 

0.32 

0.79 

-0.32 

40036 

D 

0 

3 

4 

-0.95 

0.44 

0.34 

-0.27 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40037 

* 

-1 

4815 

99 

1.00 

0.02 

0.00 

0.00 

40037 

A 

1 

65 

94 

1.09 

0.17 

0.88 

0.33 

40037 

B 

0 

2 

3 

-0.14 

0.82 

0.91 

-0.14 

40037 

C 

0 

2 

3 

-1.56 

0.96 

0.24 

-0.32 

40037 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40038 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40038 

A 

1 

52 

96 

0.78 

0.20 

0.64 

0.41 

40038 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40038 

C 

0 

1 

2 

-0.41 

0.00 

1.10 

-0.09 

40038 

D 

0 

1 

2 

-4.95 

0.00 

0.01 

-0.49 

40039 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40039 

A 

1 

46 

84 

0.98 

0.18 

0.94 

0.37 

40039 

B 

0 

4 

7 

-0.51 

0.44 

0.58 

-0.28 

40039 

C 

0 

4 

7 

0.26 

0.36 

1.14 

-0.11 

40039 

D 

0 

1 

2 

-1.88 

0.00 

0.11 

-0.28 

40040 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.01 

40040 

A 

1 

41 

69 

1.22 

0.19 

0.95 

0.47 

40040 

B 

0 

4 

7 

-0.26 

0.65 

0.67 

-0.24 

40040 

C 

0 

4 

7 

-0.35 

0.43 

0.51 

-0.26 

40040 

D 

0 

10 

17 

0.18 

0.20 

0.80 

-0.24 

40041 

* 

-1 

4622 

95 

0.98 

0.02 

0.00 

-0.06 

40041 

A 

1 

240 

92 

1.44 

0.06 

0.95 

0.35 

40041 

B 

0 

15 

6 

0.55 

0.19 

0.85 

-0.19 

40041 

C 

0 

5 

2 

-0.37 

0.22 

0.30 

-0.23 

40041 

D 

0 

2 

1 

-1.44 

0.53 

0.10 

-0.24 

40042 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.00 

40042 

A 

1 

36 

64 

1.51 

0.18 

0.86 

0.49 

40042 

B 

0 

10 

18 

0.60 

0.30 

0.98 

-0.17 

40042 

C 

0 

7 

13 

-0.08 

0.49 

0.56 

-0.35 

40042 

D 

0 

3 

5 

-0.28 

0.36 

0.35 

-0.26 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40043 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40043 

A 

1 

18 

33 

1.49 

0.34 

1.32 

0.49 

40043 

B 

0 

14 

25 

0.81 

0.31 

1.69 

0.11 

40043 

C 

0 

8 

15 

-0.17 

0.27 

0.50 

-0.23 

40043 

D 

0 

15 

27 

-0.41 

0.15 

0.37 

-0.45 

40044 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40044 

A 

1 

32 

59 

1.58 

0.21 

0.68 

0.68 

40044 

B 

0 

9 

17 

0.03 

0.20 

0.68 

-0.21 

40044 

C 

0 

3 

6 

-0.67 

0.48 

0.36 

-0.23 

40044 

D 

0 

10 

19 

-0.88 

0.36 

0.39 

-0.52 

40045 

* 

-1 

4599 

94 

0.98 

0.02 

0.00 

-0.06 

40045 

A 

1 

228 

80 

1.56 

0.07 

0.91 

0.43 

40045 

B 

0 

24 

8 

0.51 

0.14 

0.76 

-0.22 

40045 

C 

0 

25 

9 

0.44 

0.22 

0.95 

-0.24 

40045 

D 

0 

8 

3 

-0.48 

0.30 

0.32 

-0.27 

40046 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

0.01 

40046 

A 

1 

33 

70 

1.24 

0.26 

1.52 

0.35 

40046 

B 

0 

5 

11 

0.52 

0.40 

1.37 

-0.09 

40046 

C 

0 

3 

6 

-0.78 

0.15 

0.26 

-0.31 

40046 

D 

0 

6 

13 

0.29 

0.51 

1.41 

-0.17 

40047 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40047 

A 

1 

24 

44 

1.24 

0.17 

0.75 

0.57 

40047 

B 

0 

5 

9 

0.52 

0.29 

1.06 

-0.01 

40047 

C 

0 

9 

16 

0.32 

0.39 

1.19 

-0.10 

40047 

D 

0 

17 

31 

-0.27 

0.18 

0.52 

-0.53 

40048 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.00 

40048 

A 

1 

24 

39 

1.51 

0.30 

1.49 

0.32 

40048 

B 

0 

13 

21 

1.46 

0.13 

1.63 

0.19 

40048 

C 

0 

15 

25 

-0.04 

0.31 

0.53 

-0.40 

40048 

D 

0 

9 

15 

0.34 

0.53 

0.87 

-0.18 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40049 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.01 

40049 

A 

1 

23 

44 

1.60 

0.36 

1.17 

0.45 

40049 

B 

0 

6 

12 

0.66 

0.27 

1.22 

-0.04 

40049 

C 

0 

7 

13 

-0.02 

0.63 

1.15 

-0.22 

40049 

D 

0 

16 

31 

0.16 

0.20 

0.77 

-0.29 

40050 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.00 

40050 

A 

1 

38 

67 

1.56 

0.25 

0.88 

0.45 

40050 

B 

0 

9 

16 

0.08 

0.35 

0.90 

-0.25 

40050 

C 

0 

4 

7 

-0.03 

1.14 

1.27 

-0.18 

40050 

D 

0 

6 

11 

-0.11 

0.61 

0.93 

-0.24 

40051 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.00 

40051 

A 

1 

26 

53 

1.85 

0.31 

0.84 

0.57 

40051 

B 

0 

12 

24 

0.12 

0.18 

0.62 

-0.36 

40051 

C 

0 

7 

14 

0.08 

0.24 

0.60 

-0.27 

40051 

D 

0 

4 

8 

0.39 

0.47 

0.89 

-0.13 

40052 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40052 

A 

1 

29 

53 

1.58 

0.28 

0.91 

0.47 

40052 

B 

0 

4 

7 

0.63 

0.30 

1.02 

-0.06 

40052 

C 

0 

11 

20 

-0.13 

0.24 

0.56 

-0.39 

40052 

D 

0 

11 

20 

0.50 

0.32 

1.13 

-0.16 

40053 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.02 

40053 

A 

1 

37 

62 

0.97 

0.16 

1.02 

0.33 

40053 

B 

0 

1 

2 

2.10 

0.00 

4.44 

0.19 

40053 

C 

0 

17 

28 

0.17 

0.19 

0.83 

-0.37 

40053 

D 

0 

5 

8 

0.46 

0.28 

0.98 

-0.08 

40054 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.03 

40054 

A 

1 

31 

61 

1.25 

0.26 

0.93 

0.45 

40054 

B 

0 

8 

16 

-0.23 

0.30 

0.66 

-0.24 

40054 

C 

0 

8 

16 

0.36 

0.24 

1.04 

-0.09 

40054 

D 

0 

4 

8 

-1.41 

1.43 

1.28 

-0.38 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40055 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40055 

A 

1 

30 

55 

1.53 

0.29 

1.70 

0.43 

40055 

B 

0 

11 

20 

0.60 

0.25 

1.08 

-0.11 

40055 

C 

0 

3 

5 

-0.02 

0.93 

1.08 

-0.16 

40055 

D 

0 

11 

20 

-0.06 

0.32 

0.71 

-0.34 

40056 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

40056 

A 

1 

27 

55 

1.09 

0.23 

1.19 

0.35 

40056 

B 

0 

8 

16 

0.47 

0.33 

1.15 

-0.11 

40056 

C 

0 

6 

12 

-0.12 

0.21 

0.50 

-0.30 

40056 

D 

0 

8 

16 

0.51 

0.20 

0.98 

-0.10 

40057 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40057 

A 

1 

33 

59 

1.12 

0.25 

1.66 

0.20 

40057 

B 

0 

12 

21 

1.33 

0.46 

6.16 

0.16 

40057 

C 

0 

6 

11 

-0.10 

0.18 

0.48 

-0.19 

40057 

D 

0 

5 

9 

-1.10 

1.26 

1.14 

-0.36 

40058 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

40058 

A 

1 

31 

58 

0.98 

0.19 

1.11 

0.24 

40058 

B 

0 

6 

11 

0.19 

0.42 

0.93 

-0.18 

40058 

C 

0 

11 

21 

0.78 

0.32 

2.17 

0.01 

40058 

D 

0 

5 

9 

-0.01 

0.51 

0.84 

-0.23 

40059 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

0.01 

40059 

A 

1 

30 

64 

1.32 

0.24 

0.98 

0.49 

40059 

B 

0 

8 

17 

0.02 

0.37 

0.91 

-0.27 

40059 

C 

0 

1 

2 

-0.81 

0.00 

0.24 

-0.18 

40059 

D 

0 

8 

17 

-0.01 

0.32 

0.76 

-0.28 

40060 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40060 

A 

1 

34 

61 

1.13 

0.27 

1.20 

0.35 

40060 

B 

0 

5 

9 

0.50 

0.72 

3.45 

-0.04 

40060 

C 

0 

3 

5 

-1.13 

0.05 

0.22 

-0.28 

40060 

D 

0 

14 

25 

0.07 

0.33 

1.50 

-0.23 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40061 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.04 

40061 

A 

1 

30 

47 

1.10 

0.20 

1.25 

0.42 

40061 

B 

0 

3 

5 

0.54 

0.35 

1.04 

0.00 

40061 

C 

0 

6 

9 

0.15 

0.44 

0.88 

-0.11 

40061 

D 

0 

25 

39 

0.01 

0.23 

0.89 

-0.37 

40062 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.00 

40062 

A 

1 

27 

43 

2.07 

0.31 

0.93 

0.55 

40062 

B 

0 

7 

11 

0.45 

0.51 

0.99 

-0.10 

40062 

C 

0 

12 

19 

0.25 

0.22 

0.59 

-0.20 

40062 

D 

0 

17 

27 

-0.06 

0.43 

0.80 

-0.36 

40063 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.00 

40063 

A 

1 

7 

13 

3.37 

0.73 

0.84 

0.60 

40063 

B 

0 

21 

38 

0.98 

0.25 

1.10 

-0.04 

40063 

C 

0 

8 

14 

0.72 

0.47 

0.90 

-0.09 

40063 

D 

0 

20 

36 

0.44 

0.18 

0.41 

-0.31 

40064 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40064 

A 

1 

11 

20 

2.46 

0.37 

0.43 

0.68 

40064 

B 

0 

4 

7 

0.35 

0.70 

0.91 

-0.07 

40064 

C 

0 

21 

38 

0.61 

0.18 

1.01 

-0.04 

40064 

D 

0 

20 

36 

-0.15 

0.17 

0.39 

-0.48 

40065 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

40065 

A 

1 

11 

21 

1.51 

0.62 

2.22 

0.29 

40065 

B 

0 

1 

2 

1.49 

0.00 

1.59 

0.08 

40065 

C 

0 

28 

53 

0.48 

0.19 

1.02 

-0.21 

40065 

D 

0 

13 

25 

0.63 

0.35 

1.31 

-0.05 

40066 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.04 

40066 

A 

1 

27 

45 

1.51 

0.26 

1.10 

0.51 

40066 

B 

0 

12 

20 

0.15 

0.32 

0.95 

-0.09 

40066 

C 

0 

8 

13 

-0.04 

0.39 

0.77 

-0.11 

40066 

D 

0 

13 

22 

-1.00 

0.67 

0.65 

-0.43 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40067 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

40067 

A 

1 

19 

33 

1.91 

0.21 

0.78 

0.54 

40067 

B 

0 

3 

5 

-0.25 

0.78 

0.39 

-0.22 

40067 

C 

0 

24 

42 

0.78 

0.23 

1.18 

-0.10 

40067 

D 

0 

11 

19 

-0.11 

0.29 

0.39 

-0.40 

40068 

* 

-1 

1847 

38 

1.35 

0.03 

0.00 

0.22 

40068 

A 

1 

657 

22 

1.94 

0.06 

1.17 

0.46 

40068 

B 

0 

1435 

47 

0.62 

0.03 

1.01 

-0.11 

40068 

C 

0 

371 

12 

0.39 

0.06 

0.89 

-0.11 

40068 

D 

0 

574 

19 

0.10 

0.05 

0.66 

-0.25 

40069 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

-0.01 

40069 

A 

1 

6 

12 

4.40 

0.49 

0.14 

0.78 

40069 

B 

0 

30 

59 

0.73 

0.17 

0.69 

-0.31 

40069 

C 

0 

5 

10 

1.41 

0.16 

0.88 

0.06 

40069 

D 

0 

10 

20 

0.24 

0.33 

0.39 

-0.29 

40070 

* 

-1 

4604 

94 

0.99 

0.02 

0.00 

-0.03 

40070 

A 

1 

147 

53 

1.59 

0.08 

0.95 

0.46 

40070 

B 

0 

73 

26 

0.83 

0.08 

1.00 

-0.19 

40070 

C 

0 

44 

16 

0.58 

0.13 

0.79 

-0.24 

40070 

D 

0 

16 

6 

0.13 

0.26 

0.61 

-0.25 

40071 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.02 

40071 

A 

1 

16 

27 

1.57 

0.34 

1.48 

0.39 

40071 

B 

0 

2 

3 

-1.59 

0.07 

0.07 

-0.34 

40071 

C 

0 

22 

37 

0.71 

0.24 

1.27 

-0.03 

40071 

D 

0 

19 

32 

0.36 

0.24 

0.81 

-0.21 

40072 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40072 

A 

1 

20 

36 

1.46 

0.31 

1.33 

0.36 

40072 

B 

0 

12 

21 

0.39 

0.20 

0.67 

-0.15 

40072 

C 

0 

9 

16 

0.98 

0.22 

1.16 

0.06 

40072 

D 

0 

15 

27 

0.10 

0.45 

0.94 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40073 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40073 

A 

1 

12 

22 

2.04 

0.41 

0.67 

0.60 

40073 

B 

0 

6 

11 

0.28 

0.45 

0.84 

-0.09 

40073 

C 

0 

12 

22 

0.14 

0.30 

0.72 

-0.19 

40073 

D 

0 

25 

45 

0.21 

0.17 

0.69 

-0.28 

40074 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.00 

40074 

A 

1 

43 

75 

1.12 

0.18 

1.12 

0.24 

40074 

B 

0 

10 

18 

0.67 

0.46 

1.95 

-0.10 

40074 

C 

0 

1 

2 

0.38 

0.00 

0.79 

-0.06 

40074 

D 

0 

3 

5 

-0.49 

0.69 

0.51 

-0.27 

40075 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40075 

A 

1 

41 

73 

0.94 

0.17 

1.15 

0.38 

40075 

B 

0 

3 

5 

0.79 

0.26 

1.54 

0.02 

40075 

C 

0 

4 

7 

-0.08 

0.41 

0.76 

-0.19 

40075 

D 

0 

8 

14 

-0.30 

0.43 

1.11 

-0.35 

40076 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.00 

40076 

A 

1 

38 

64 

1.34 

0.20 

1.03 

0.39 

40076 

B 

0 

5 

8 

-0.79 

0.47 

0.32 

-0.40 

40076 

C 

0 

5 

8 

0.63 

0.53 

1.39 

-0.07 

40076 

D 

0 

11 

19 

0.54 

0.38 

2.31 

-0.15 

40077 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40077 

A 

1 

28 

54 

1.31 

0.26 

0.99 

0.36 

40077 

B 

0 

4 

8 

1.18 

0.59 

2.35 

0.07 

40077 

C 

0 

4 

8 

0.33 

0.21 

0.73 

-0.08 

40077 

D 

0 

16 

31 

-0.17 

0.49 

1.32 

-0.39 

40078 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

-0.01 

40078 

A 

1 

49 

89 

1.20 

0.21 

0.96 

0.26 

40078 

B 

0 

2 

4 

0.99 

0.20 

1.72 

-0.01 

40078 

C 

0 

2 

4 

-0.38 

1.06 

0.70 

-0.20 

40078 

D 

0 

2 

4 

-0.59 

0.08 

0.35 

-0.22 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


240 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40079 

* 

-1 

4617 

95 

0.99 

0.02 

0.00 

-0.03 

40079 

A 

1 

218 

82 

1.36 

0.07 

1.03 

0.37 

40079 

B 

0 

30 

11 

0.31 

0.14 

0.72 

-0.30 

40079 

C 

0 

17 

6 

0.56 

0.22 

1.15 

-0.15 

40079 

D 

0 

2 

1 

-0.26 

0.83 

0.44 

-0.12 

40080 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40080 

A 

1 

47 

87 

0.83 

0.18 

1.07 

0.19 

40080 

B 

0 

2 

4 

0.90 

0.33 

1.93 

0.03 

40080 

C 

0 

3 

6 

-0.15 

0.81 

1.22 

-0.18 

40080 

D 

0 

2 

4 

-0.13 

0.72 

0.83 

-0.14 

40081 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40081 

A 

1 

28 

50 

0.88 

0.19 

1.25 

0.28 

40081 

B 

0 

12 

21 

0.51 

0.24 

1.18 

0.00 

40081 

C 

0 

4 

7 

0.64 

0.31 

1.16 

0.03 

40081 

D 

0 

12 

21 

-0.36 

0.58 

0.95 

-0.35 

40082 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.05 

40082 

A 

1 

33 

60 

0.72 

0.18 

1.23 

0.39 

40082 

B 

0 

9 

16 

0.10 

0.28 

1.11 

-0.12 

40082 

C 

0 

7 

13 

-0.12 

0.38 

0.99 

-0.18 

40082 

D 

0 

6 

11 

-0.42 

0.45 

0.92 

-0.27 

40083 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40083 

A 

1 

27 

48 

1.48 

0.26 

1.19 

0.41 

40083 

B 

0 

7 

13 

-0.51 

0.75 

0.71 

-0.37 

40083 

C 

0 

10 

18 

0.65 

0.36 

1.72 

-0.07 

40083 

D 

0 

12 

21 

0.51 

0.20 

0.85 

-0.13 

40084 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.04 

40084 

A 

1 

31 

52 

1.32 

0.19 

0.66 

0.62 

40084 

B 

0 

7 

12 

-0.04 

0.27 

0.71 

-0.14 

40084 

C 

0 

4 

7 

-0.94 

0.47 

0.34 

-0.28 

40084 

D 

0 

18 

30 

-0.37 

0.30 

0.71 

-0.42 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40085 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40085 

A 

1 

18 

33 

2.09 

0.26 

0.90 

0.58 

40085 

B 

0 

12 

22 

0.53 

0.31 

0.80 

-0.18 

40085 

C 

0 

23 

42 

0.49 

0.24 

0.83 

-0.32 

40085 

D 

0 

2 

4 

-0.35 

0.16 

0.21 

-0.20 

40086 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.03 

40086 

A 

1 

32 

64 

1.12 

0.19 

0.90 

0.48 

40086 

B 

0 

1 

2 

-2.51 

0.00 

0.05 

-0.34 

40086 

C 

0 

3 

6 

0.04 

0.90 

1.09 

-0.12 

40086 

D 

0 

14 

28 

-0.08 

0.33 

0.93 

-0.34 

40087 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40087 

A 

1 

37 

67 

1.09 

0.20 

0.94 

0.55 

40087 

B 

0 

5 

9 

-0.59 

0.37 

0.55 

-0.31 

40087 

C 

0 

6 

11 

-0.14 

0.26 

0.77 

-0.21 

40087 

D 

0 

7 

13 

-0.43 

0.19 

0.52 

-0.32 

40088 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

-0.02 

40088 

A 

1 

35 

54 

1.60 

0.17 

1.04 

0.40 

40088 

B 

0 

14 

22 

0.84 

0.17 

0.83 

-0.18 

40088 

C 

0 

4 

6 

0.93 

0.81 

2.13 

-0.07 

40088 

D 

0 

12 

18 

0.57 

0.34 

0.89 

-0.28 

40089 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.02 

40089 

A 

1 

45 

69 

1.12 

0.16 

0.99 

0.43 

40089 

B 

0 

6 

9 

0.35 

0.48 

1.28 

-0.12 

40089 

C 

0 

7 

11 

0.31 

0.34 

1.06 

-0.14 

40089 

D 

0 

7 

11 

-0.54 

0.49 

0.61 

-0.39 

40090 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.00 

40090 

A 

1 

14 

27 

2.27 

0.23 

0.53 

0.62 

40090 

B 

0 

6 

12 

0.68 

0.25 

0.61 

-0.11 

40090 

C 

0 

12 

23 

0.46 

0.32 

0.62 

-0.27 

40090 

D 

0 

20 

38 

0.67 

0.23 

0.77 

-0.25 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40091 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.00 

40091 

A 

1 

52 

93 

1.17 

0.21 

0.85 

0.35 

40091 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40091 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40091 

D 

0 

4 

7 

-1.05 

0.99 

1.34 

-0.35 

40092 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.03 

40092 

A 

1 

50 

83 

1.02 

0.17 

0.93 

0.49 

40092 

B 

0 

7 

12 

-0.28 

0.38 

0.82 

-0.23 

40092 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40092 

D 

0 

3 

5 

-2.74 

1.68 

0.27 

-0.51 

40093 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.01 

40093 

A 

1 

42 

79 

1.15 

0.24 

1.04 

0.33 

40093 

B 

0 

8 

15 

0.09 

0.39 

1.48 

-0.22 

40093 

C 

0 

2 

4 

-0.53 

0.13 

0.43 

-0.18 

40093 

D 

0 

1 

2 

-0.75 

0.00 

0.35 

-0.15 

40094 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.03 

40094 

A 

1 

38 

59 

1.23 

0.17 

0.86 

0.48 

40094 

B 

0 

7 

11 

0.67 

0.26 

1.30 

0.01 

40094 

C 

0 

9 

14 

-0.18 

0.50 

0.88 

-0.22 

40094 

D 

0 

10 

16 

-0.88 

0.65 

0.64 

-0.44 

40095 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

-0.01 

40095 

A 

1 

43 

78 

1.55 

0.20 

0.77 

0.59 

40095 

B 

0 

3 

5 

0.20 

0.27 

0.72 

-0.15 

40095 

C 

0 

3 

5 

-0.75 

0.59 

0.35 

-0.30 

40095 

D 

0 

6 

11 

-0.75 

0.23 

0.29 

-0.45 

40096 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.01 

40096 

A 

1 

49 

83 

1.19 

0.21 

0.90 

0.47 

40096 

B 

0 

4 

7 

-0.12 

0.31 

0.72 

-0.15 

40096 

C 

0 

4 

7 

-1.88 

1.22 

0.38 

-0.43 

40096 

D 

0 

2 

3 

-0.77 

0.15 

0.33 

-0.18 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40097 

* 

-1 

4831 

99 

0.99 

0.02 

0.00 

-0.02 

40097 

A 

1 

44 

83 

1.49 

0.22 

0.92 

0.29 

40097 

B 

0 

5 

9 

0.51 

0.72 

2.42 

-0.17 

40097 

C 

0 

2 

4 

0.65 

1.72 

2.83 

-0.09 

40097 

D 

0 

2 

4 

-0.49 

0.76 

0.41 

-0.24 

40098 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.01 

40098 

A 

1 

56 

88 

1.24 

0.15 

1.09 

0.53 

40098 

B 

0 

2 

3 

-0.91 

0.32 

0.25 

-0.22 

40098 

C 

0 

5 

8 

-0.30 

0.63 

1.01 

-0.24 

40098 

D 

0 

1 

2 

-6.10 

0.00 

0.00 

-0.59 

40099 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40099 

A 

1 

43 

77 

1.07 

0.21 

1.03 

0.37 

40099 

B 

0 

3 

5 

-0.49 

0.14 

0.43 

-0.22 

40099 

C 

0 

9 

16 

0.21 

0.25 

1.11 

-0.19 

40099 

D 

0 

1 

2 

-2.06 

0.00 

0.09 

-0.28 

40100 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40100 

A 

1 

44 

85 

1.05 

0.21 

0.89 

0.41 

40100 

B 

0 

3 

6 

-1.28 

1.13 

0.61 

-0.34 

40100 

C 

0 

3 

6 

0.08 

0.45 

1.09 

-0.12 

40100 

D 

0 

2 

4 

-0.79 

0.16 

0.37 

-0.21 

40101 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40101 

A 

1 

7 

13 

2.27 

0.69 

1.28 

0.43 

40101 

B 

0 

43 

80 

0.82 

0.13 

0.86 

-0.08 

40101 

C 

0 

3 

6 

-0.45 

0.66 

0.23 

-0.25 

40101 

D 

0 

1 

2 

-2.84 

0.00 

0.02 

-0.41 

40102 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40102 

A 

1 

2 

4 

0.68 

0.86 

2.83 

-0.01 

40102 

B 

0 

3 

5 

-0.99 

0.33 

0.10 

-0.33 

40102 

C 

0 

49 

89 

0.87 

0.18 

1.17 

0.31 

40102 

D 

0 

1 

2 

-0.59 

0.00 

0.14 

-0.14 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40103 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

-0.01 

40103 

A 

1 

9 

19 

2.25 

0.74 

1.70 

0.36 

40103 

B 

0 

19 

40 

0.43 

0.23 

0.62 

-0.43 

40103 

C 

0 

17 

35 

1.58 

0.24 

2.03 

0.20 

40103 

D 

0 

3 

6 

0.59 

0.26 

0.50 

-0.11 

40104 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40104 

A 

1 

1 

2 

0.82 

0.00 

1.40 

0.02 

40104 

B 

0 

2 

4 

1.89 

0.66 

2.56 

0.23 

40104 

C 

0 

50 

93 

0.64 

0.14 

1.00 

0.01 

40104 

D 

0 

1 

2 

-2.14 

0.00 

0.04 

-0.36 

40105 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40105 

A 

1 

5 

9 

1.94 

0.93 

1.97 

0.29 

40105 

B 

0 

21 

38 

0.51 

0.24 

0.77 

-0.12 

40105 

C 

0 

28 

50 

0.65 

0.26 

0.91 

-0.04 

40105 

D 

0 

2 

4 

0.60 

0.37 

0.51 

-0.02 

40106 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40106 

A 

1 

42 

81 

1.13 

0.18 

0.85 

0.60 

40106 

B 

0 

3 

6 

-0.19 

0.07 

0.61 

-0.15 

40106 

C 

0 

5 

10 

-1.05 

0.48 

0.37 

-0.39 

40106 

D 

0 

2 

4 

-2.48 

1.04 

0.17 

-0.44 

40107 

* 

-1 

4814 

99 

1.00 

0.02 

0.00 

0.01 

40107 

A 

1 

11 

16 

1.65 

0.57 

2.72 

0.25 

40107 

B 

0 

49 

70 

0.90 

0.14 

1.03 

-0.04 

40107 

C 

0 

4 

6 

1.16 

0.58 

1.34 

0.04 

40107 

D 

0 

6 

9 

-0.22 

0.36 

0.27 

-0.29 

40108 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

40108 

A 

1 

24 

41 

1.24 

0.26 

1.26 

0.29 

40108 

B 

0 

6 

10 

0.80 

0.36 

1.29 

0.00 

40108 

C 

0 

16 

28 

0.71 

0.22 

1.42 

-0.04 

40108 

D 

0 

12 

21 

0.03 

0.48 

0.96 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40109 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40109 

A 

1 

16 

29 

1.32 

0.29 

1.29 

0.38 

40109 

B 

0 

26 

46 

0.54 

0.16 

1.06 

-0.13 

40109 

C 

0 

5 

9 

0.41 

0.40 

0.86 

-0.08 

40109 

D 

0 

9 

16 

0.13 

0.41 

0.78 

-0.23 

40110 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40110 

A 

1 

39 

70 

1.04 

0.17 

0.96 

0.36 

40110 

B 

0 

6 

11 

-0.04 

0.54 

0.98 

-0.22 

40110 

C 

0 

8 

14 

0.54 

0.50 

2.07 

-0.07 

40110 

D 

0 

3 

5 

-0.96 

0.44 

0.28 

-0.33 

40111 

* 

-1 

4829 

99 

1.01 

0.02 

0.00 

0.06 

40111 

A 

1 

35 

64 

0.58 

0.23 

1.00 

0.32 

40111 

B 

0 

10 

18 

0.40 

0.57 

8.12 

0.06 

40111 

C 

0 

6 

11 

-1.29 

0.36 

0.40 

-0.36 

40111 

D 

0 

4 

7 

-1.12 

0.23 

0.38 

-0.25 

40112 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.01 

40112 

A 

1 

37 

57 

1.31 

0.20 

1.07 

0.36 

40112 

B 

0 

13 

20 

0.11 

0.26 

0.78 

-0.33 

40112 

C 

0 

13 

20 

0.63 

0.34 

1.93 

-0.12 

40112 

D 

0 

2 

3 

0.92 

0.12 

1.19 

0.00 

40113 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40113 

A 

1 

32 

55 

0.99 

0.17 

1.13 

0.34 

40113 

B 

0 

1 

2 

0.11 

0.00 

0.57 

-0.08 

40113 

C 

0 

24 

41 

0.32 

0.17 

0.91 

-0.34 

40113 

D 

0 

1 

2 

1.03 

0.00 

1.43 

0.05 

40114 

* 

-1 

4810 

98 

1.00 

0.02 

0.00 

0.02 

40114 

A 

1 

44 

59 

1.32 

0.17 

0.88 

0.51 

40114 

B 

0 

22 

30 

0.24 

0.16 

0.81 

-0.33 

40114 

C 

0 

8 

11 

-0.25 

0.20 

0.47 

-0.32 

40114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40115 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40115 

A 

1 

49 

86 

0.95 

0.18 

1.08 

0.27 

40115 

B 

0 

6 

11 

-0.16 

0.22 

0.65 

-0.27 

40115 

C 

0 

2 

4 

0.42 

0.01 

1.06 

-0.06 

40115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40116 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40116 

A 

1 

28 

51 

1.27 

0.22 

1.01 

0.45 

40116 

B 

0 

21 

38 

0.44 

0.18 

0.96 

-0.22 

40116 

C 

0 

4 

7 

-0.39 

0.46 

0.41 

-0.28 

40116 

D 

0 

2 

4 

-0.78 

1.21 

0.40 

-0.26 

40117 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40117 

A 

1 

38 

69 

1.16 

0.17 

1.16 

0.41 

40117 

B 

0 

4 

7 

0.29 

0.38 

0.85 

-0.11 

40117 

C 

0 

12 

22 

0.33 

0.25 

0.91 

-0.19 

40117 

D 

0 

1 

2 

-5.35 

0.00 

0.00 

-0.63 

40118 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.02 

40118 

A 

1 

24 

48 

1.70 

0.30 

0.89 

0.54 

40118 

B 

0 

1 

2 

0.37 

0.00 

0.67 

-0.04 

40118 

C 

0 

25 

50 

-0.05 

0.27 

0.89 

-0.53 

40118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40119 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.05 

40119 

A 

1 

24 

44 

0.20 

0.24 

2.28 

-0.16 

40119 

B 

0 

27 

49 

0.76 

0.17 

1.91 

0.32 

40119 

C 

0 

2 

4 

-1.35 

1.68 

0.44 

-0.30 

40119 

D 

0 

2 

4 

-0.32 

0.83 

0.61 

-0.12 

40120 

* 

-1 

1851 

38 

1.35 

0.03 

0.00 

0.22 

40120 

A 

1 

775 

26 

1.37 

0.06 

2.03 

0.26 

40120 

B 

0 

1050 

35 

0.93 

0.03 

1.50 

0.08 

40120 

C 

0 

977 

32 

0.44 

0.03 

0.94 

-0.18 

40120 

D 

0 

231 

8 

-0.43 

0.10 

0.52 

-0.26 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40121 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.02 

40121 

A 

1 

6 

10 

1.59 

0.83 

2.75 

0.24 

40121 

B 

0 

29 

49 

0.93 

0.17 

1.20 

0.16 

40121 

C 

0 

18 

31 

0.56 

0.17 

0.64 

-0.10 

40121 

D 

0 

6 

10 

-0.49 

0.74 

0.52 

-0.35 

40122 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40122 

A 

1 

24 

43 

1.49 

0.32 

1.29 

0.49 

40122 

B 

0 

2 

4 

0.57 

0.59 

1.02 

-0.02 

40122 

C 

0 

20 

36 

0.48 

0.11 

0.87 

-0.13 

40122 

D 

0 

10 

18 

-0.68 

0.28 

0.36 

-0.47 

40123 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.02 

40123 

A 

1 

7 

11 

1.75 

0.55 

1.05 

0.30 

40123 

B 

0 

32 

52 

0.73 

0.23 

1.22 

0.00 

40123 

C 

0 

17 

27 

0.42 

0.25 

0.76 

-0.16 

40123 

D 

0 

6 

10 

0.47 

0.25 

0.55 

-0.07 

40124 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40124 

A 

1 

8 

14 

0.91 

0.56 

2.95 

0.00 

40124 

B 

0 

10 

18 

0.55 

0.37 

0.73 

-0.12 

40124 

C 

0 

35 

63 

1.01 

0.22 

1.48 

0.11 

40124 

D 

0 

3 

5 

0.75 

0.96 

0.94 

-0.03 

40125 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40125 

A 

1 

27 

48 

1.75 

0.19 

0.52 

0.66 

40125 

B 

0 

1 

2 

0.77 

0.00 

0.99 

0.00 

40125 

C 

0 

23 

41 

0.08 

0.15 

0.64 

-0.37 

40125 

D 

0 

5 

9 

-1.74 

0.95 

0.24 

-0.52 

40126 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40126 

A 

1 

7 

13 

1.37 

0.77 

1.93 

0.20 

40126 

B 

0 

20 

36 

1.13 

0.21 

1.80 

0.26 

40126 

C 

0 

20 

36 

0.24 

0.24 

0.73 

-0.31 

40126 

D 

0 

8 

15 

0.37 

0.25 

0.66 

-0.12 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40127 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.04 

40127 

A 

1 

48 

83 

0.77 

0.20 

1.00 

0.30 

40127 

B 

0 

7 

12 

0.26 

0.23 

1.44 

-0.08 

40127 

C 

0 

2 

3 

-1.41 

0.35 

0.24 

-0.27 

40127 

D 

0 

1 

2 

-2.40 

0.00 

0.08 

-0.28 

40128 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.03 

40128 

A 

1 

48 

92 

0.81 

0.18 

1.15 

0.48 

40128 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40128 

C 

0 

3 

6 

-0.77 

0.11 

0.43 

-0.22 

40128 

D 

0 

1 

2 

-5.54 

0.00 

0.00 

-0.56 

40129 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40129 

A 

1 

39 

70 

1.14 

0.15 

0.77 

0.59 

40129 

B 

0 

5 

9 

-0.25 

0.39 

0.65 

-0.17 

40129 

C 

0 

6 

11 

-0.32 

0.22 

0.51 

-0.21 

40129 

D 

0 

6 

11 

-1.62 

1.06 

0.92 

-0.52 

40130 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40130 

A 

1 

47 

82 

0.89 

0.18 

0.99 

0.38 

40130 

B 

0 

7 

12 

-0.44 

0.34 

0.65 

-0.34 

40130 

C 

0 

1 

2 

1.09 

0.00 

2.31 

0.04 

40130 

D 

0 

2 

4 

-0.69 

0.20 

0.39 

-0.21 

40131 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.02 

40131 

A 

1 

37 

77 

1.04 

0.28 

1.04 

0.38 

40131 

B 

0 

7 

15 

-0.50 

0.40 

0.80 

-0.30 

40131 

C 

0 

1 

2 

0.33 

0.00 

1.23 

-0.03 

40131 

D 

0 

3 

6 

-0.60 

0.26 

0.52 

-0.20 

40132 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40132 

A 

1 

48 

86 

0.98 

0.17 

0.97 

0.50 

40132 

B 

0 

4 

7 

-0.37 

0.29 

0.56 

-0.19 

40132 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40132 

D 

0 

4 

7 

-1.90 

1.28 

0.46 

-0.48 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40133 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40133 

A 

1 

44 

80 

0.88 

0.17 

0.93 

0.35 

40133 

B 

0 

1 

2 

-1.42 

0.00 

0.18 

-0.24 

40133 

C 

0 

7 

13 

0.25 

0.53 

3.15 

-0.13 

40133 

D 

0 

3 

5 

-0.69 

0.07 

0.37 

-0.27 

40134 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.05 

40134 

A 

1 

40 

73 

0.90 

0.21 

0.84 

0.53 

40134 

B 

0 

4 

7 

-0.86 

0.57 

0.65 

-0.22 

40134 

C 

0 

3 

5 

-1.37 

0.37 

0.26 

-0.27 

40134 

D 

0 

8 

15 

-0.87 

0.68 

0.95 

-0.33 

40135 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

40135 

A 

1 

45 

90 

1.04 

0.22 

1.09 

0.26 

40135 

B 

0 

1 

2 

-1.36 

0.00 

0.21 

-0.22 

40135 

C 

0 

2 

4 

-0.34 

0.21 

0.60 

-0.17 

40135 

D 

0 

2 

4 

0.48 

0.91 

1.92 

-0.06 

40136 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.03 

40136 

A 

1 

50 

82 

0.94 

0.21 

1.04 

0.32 

40136 

B 

0 

4 

7 

-0.38 

0.80 

1.34 

-0.18 

40136 

C 

0 

2 

3 

-2.97 

0.42 

0.05 

-0.43 

40136 

D 

0 

5 

8 

0.66 

0.20 

1.87 

-0.01 

40137 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40137 

A 

1 

43 

75 

1.07 

0.15 

0.83 

0.55 

40137 

B 

0 

1 

2 

0.46 

0.00 

0.96 

-0.02 

40137 

C 

0 

5 

9 

-0.07 

0.35 

0.74 

-0.17 

40137 

D 

0 

8 

14 

-1.09 

0.65 

0.45 

-0.53 

40138 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.04 

40138 

A 

1 

46 

78 

0.89 

0.16 

1.03 

0.44 

40138 

B 

0 

5 

8 

-0.10 

0.74 

1.44 

-0.15 

40138 

C 

0 

1 

2 

-0.60 

0.00 

0.39 

-0.11 

40138 

D 

0 

7 

12 

-0.92 

0.76 

0.69 

-0.40 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40139 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.04 

40139 

A 

1 

48 

83 

0.83 

0.13 

0.85 

0.57 

40139 

B 

0 

1 

2 

-0.42 

0.00 

0.47 

-0.10 

40139 

C 

0 

3 

5 

-0.62 

0.28 

0.41 

-0.22 

40139 

D 

0 

6 

10 

-1.32 

0.83 

0.48 

-0.51 

40140 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

40140 

A 

1 

51 

89 

0.63 

0.17 

1.05 

0.13 

40140 

B 

0 

2 

4 

0.65 

1.55 

4.21 

0.01 

40140 

C 

0 

1 

2 

-0.59 

0.00 

0.50 

-0.13 

40140 

D 

0 

3 

5 

0.03 

0.63 

1.39 

-0.11 

40141 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40141 

A 

1 

49 

84 

0.84 

0.18 

1.01 

0.33 

40141 

B 

0 

3 

5 

-1.06 

0.15 

0.30 

-0.30 

40141 

C 

0 

5 

9 

0.20 

0.53 

1.46 

-0.11 

40141 

D 

0 

1 

2 

-1.10 

0.00 

0.28 

-0.18 

40142 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.00 

40142 

A 

1 

56 

93 

1.18 

0.15 

0.76 

0.48 

40142 

B 

0 

1 

2 

-3.26 

0.00 

0.03 

-0.43 

40142 

C 

0 

1 

2 

-0.84 

0.00 

0.31 

-0.19 

40142 

D 

0 

2 

3 

-0.54 

1.04 

0.66 

-0.23 

40143 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.04 

40143 

A 

-1 

64 

100 

0.57 

0.13 

0.00 

0.00 

40143 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40143 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40143 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40144 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.05 

40144 

A 

1 

48 

96 

0.46 

0.17 

1.11 

0.23 

40144 

B 

0 

1 

2 

-1.33 

0.00 

0.35 

-0.21 

40144 

C 

0 

1 

2 

-0.54 

0.00 

0.77 

-0.11 

40144 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40145 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40145 

A 

1 

52 

93 

0.74 

0.14 

0.77 

0.54 

40145 

B 

0 

4 

7 

-1.71 

0.34 

0.21 

-0.54 

40145 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40145 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40146 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40146 

A 

1 

53 

96 

1.14 

0.17 

0.96 

0.38 

40146 

B 

0 

1 

2 

-1.91 

0.00 

0.12 

-0.30 

40146 

C 

0 

1 

2 

-1.23 

0.00 

0.23 

-0.23 

40146 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40147 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40147 

A 

1 

53 

98 

0.66 

0.18 

1.04 

0.06 

40147 

B 

0 

1 

2 

0.08 

0.00 

1.12 

-0.06 

40147 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40147 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40148 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

40148 

A 

1 

49 

86 

0.86 

0.14 

0.87 

0.50 

40148 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40148 

C 

0 

6 

11 

-0.24 

0.50 

1.00 

-0.21 

40148 

D 

0 

2 

4 

-3.66 

1.69 

0.10 

-0.60 

40149 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.02 

40149 

A 

1 

55 

93 

0.98 

0.14 

0.66 

0.59 

40149 

B 

0 

2 

3 

-0.75 

0.24 

0.48 

-0.21 

40149 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40149 

D 

0 

2 

3 

-3.72 

1.23 

0.04 

-0.61 

40150 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40150 

A 

1 

52 

93 

0.64 

0.15 

0.99 

0.28 

40150 

B 

0 

1 

2 

-1.76 

0.00 

0.17 

-0.27 

40150 

C 

0 

2 

4 

0.16 

1.33 

2.38 

-0.07 

40150 

D 

0 

1 

2 

-1.01 

0.00 

0.37 

-0.18 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40151 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.02 

40151 

A 

-1 

48 

100 

0.75 

0.19 

0.00 

0.00 

40151 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40151 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40151 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40152 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.03 

40152 

A 

1 

49 

83 

0.94 

0.14 

0.80 

0.54 

40152 

B 

0 

3 

5 

-0.69 

0.57 

0.51 

-0.28 

40152 

C 

0 

3 

5 

-0.33 

0.37 

0.58 

-0.21 

40152 

D 

0 

4 

7 

-0.87 

0.21 

0.32 

-0.37 

40153 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40153 

A 

1 

54 

98 

0.81 

0.20 

0.85 

0.32 

40153 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40153 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40153 

D 

0 

1 

2 

-2.84 

0.00 

0.08 

-0.32 

40154 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40154 

A 

1 

48 

86 

0.80 

0.20 

1.18 

0.21 

40154 

B 

0 

1 

2 

0.24 

0.00 

1.08 

-0.05 

40154 

C 

0 

1 

2 

0.20 

0.00 

1.04 

-0.05 

40154 

D 

0 

6 

11 

-0.06 

0.34 

1.03 

-0.20 

40155 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.01 

40155 

A 

1 

63 

97 

0.99 

0.14 

0.91 

0.36 

40155 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40155 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40155 

D 

0 

2 

3 

-1.57 

0.96 

0.26 

-0.36 

40156 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40156 

A 

1 

50 

91 

0.86 

0.17 

0.66 

0.58 

40156 

B 

0 

1 

2 

-0.79 

0.00 

0.50 

-0.14 

40156 

C 

0 

2 

4 

-1.71 

0.34 

0.21 

-0.32 

40156 

D 

0 

2 

4 

-2.80 

0.05 

0.07 

-0.47 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40157 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40157 

A 

1 

45 

82 

0.98 

0.20 

0.94 

0.39 

40157 

B 

0 

6 

11 

-0.73 

0.35 

0.52 

-0.39 

40157 

C 

0 

3 

5 

0.33 

0.48 

1.26 

-0.07 

40157 

D 

0 

1 

2 

-0.12 

0.00 

0.66 

-0.09 

40158 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40158 

A 

1 

52 

93 

0.69 

0.15 

0.97 

0.18 

40158 

B 

0 

2 

4 

-0.49 

1.50 

1.20 

-0.20 

40158 

C 

0 

2 

4 

0.36 

0.60 

1.43 

-0.05 

40158 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40159 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

40159 

A 

1 

50 

88 

0.80 

0.22 

0.97 

0.40 

40159 

B 

0 

5 

9 

-1.26 

0.27 

0.40 

-0.34 

40159 

C 

0 

1 

2 

0.48 

0.00 

2.02 

-0.01 

40159 

D 

0 

1 

2 

-2.52 

0.00 

0.10 

-0.25 

40160 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40160 

A 

1 

49 

91 

0.76 

0.16 

0.84 

0.50 

40160 

B 

0 

2 

4 

-1.17 

0.78 

0.42 

-0.27 

40160 

C 

0 

1 

2 

-2.47 

0.00 

0.09 

-0.33 

40160 

D 

0 

2 

4 

-1.03 

0.32 

0.38 

-0.25 

40161 

* 

-1 

4839 

99 

1.00 

0.02 

0.00 

0.04 

40161 

A 

1 

26 

58 

1.32 

0.25 

1.06 

0.63 

40161 

B 

0 

6 

13 

-0.84 

0.56 

0.62 

-0.32 

40161 

C 

0 

6 

13 

-0.53 

0.62 

0.76 

-0.24 

40161 

D 

0 

7 

16 

-0.76 

0.38 

0.48 

-0.33 

40162 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40162 

A 

1 

51 

94 

0.88 

0.18 

0.86 

0.39 

40162 

B 

0 

1 

2 

-1.25 

0.00 

0.25 

-0.21 

40162 

C 

0 

1 

2 

-1.15 

0.00 

0.28 

-0.20 

40162 

D 

0 

1 

2 

-1.84 

0.00 

0.14 

-0.27 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40163 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40163 

A 

1 

28 

51 

1.81 

0.25 

1.20 

0.64 

40163 

B 

0 

10 

18 

-0.12 

0.14 

0.40 

-0.38 

40163 

C 

0 

13 

24 

0.25 

0.19 

0.66 

-0.30 

40163 

D 

0 

4 

7 

0.05 

0.54 

0.71 

-0.19 

40164 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40164 

A 

1 

43 

80 

0.98 

0.21 

0.94 

0.34 

40164 

B 

0 

1 

2 

-0.26 

0.00 

0.56 

-0.10 

40164 

C 

0 

4 

7 

0.46 

0.28 

1.26 

-0.06 

40164 

D 

0 

6 

11 

-0.61 

0.42 

0.57 

-0.35 

40165 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40165 

A 

1 

44 

79 

1.06 

0.14 

0.88 

0.51 

40165 

B 

0 

5 

9 

-0.15 

0.13 

0.53 

-0.29 

40165 

C 

0 

3 

5 

-0.34 

0.47 

0.53 

-0.27 

40165 

D 

0 

4 

7 

-0.18 

0.40 

0.65 

-0.27 

40166 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.00 

40166 

A 

1 

45 

78 

1.20 

0.21 

1.26 

0.32 

40166 

B 

0 

2 

3 

0.70 

1.65 

3.32 

-0.03 

40166 

C 

0 

6 

10 

-0.65 

0.38 

0.51 

-0.38 

40166 

D 

0 

5 

9 

0.80 

0.56 

2.29 

-0.03 

40167 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

40167 

A 

1 

48 

83 

0.98 

0.15 

0.90 

0.42 

40167 

B 

0 

4 

7 

-0.01 

0.36 

0.71 

-0.21 

40167 

C 

0 

1 

2 

0.33 

0.00 

0.84 

-0.06 

40167 

D 

0 

5 

9 

-0.38 

0.18 

0.44 

-0.35 

40168 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40168 

A 

1 

41 

75 

1.23 

0.18 

0.98 

0.47 

40168 

B 

0 

3 

5 

0.11 

0.74 

0.99 

-0.15 

40168 

C 

0 

7 

13 

-0.01 

0.31 

0.69 

-0.28 

40168 

D 

0 

4 

7 

-0.44 

0.42 

0.46 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40169 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.00 

40169 

A 

1 

41 

77 

1.18 

0.21 

1.09 

0.30 

40169 

B 

0 

6 

11 

0.35 

0.39 

1.17 

-0.15 

40169 

C 

0 

4 

8 

0.34 

1.42 

4.06 

-0.12 

40169 

D 

0 

2 

4 

-0.88 

0.67 

0.30 

-0.25 

40170 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40170 

A 

1 

48 

87 

1.11 

0.18 

0.97 

0.41 

40170 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40170 

C 

0 

2 

4 

-0.25 

0.56 

0.64 

-0.17 

40170 

D 

0 

5 

9 

-0.63 

0.32 

0.48 

-0.37 

40171 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40171 

A 

1 

35 

63 

1.24 

0.20 

1.10 

0.49 

40171 

B 

0 

7 

13 

-0.26 

0.34 

0.63 

-0.28 

40171 

C 

0 

9 

16 

0.02 

0.45 

1.24 

-0.23 

40171 

D 

0 

5 

9 

-0.14 

0.55 

1.13 

-0.20 

40172 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40172 

A 

1 

40 

71 

1.12 

0.21 

0.89 

0.50 

40172 

B 

0 

9 

16 

-0.05 

0.18 

0.75 

-0.24 

40172 

C 

0 

1 

2 

-0.69 

0.00 

0.35 

-0.14 

40172 

D 

0 

6 

11 

-0.79 

0.25 

0.37 

-0.39 

40173 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40173 

A 

1 

42 

78 

0.99 

0.20 

0.96 

0.48 

40173 

B 

0 

2 

4 

-2.17 

0.72 

0.11 

-0.35 

40173 

C 

0 

6 

11 

0.19 

0.26 

1.09 

-0.09 

40173 

D 

0 

4 

7 

-1.61 

1.12 

0.65 

-0.40 

40174 

* 

-1 

4817 

99 

1.00 

0.02 

0.00 

0.00 

40174 

A 

1 

56 

84 

1.13 

0.12 

0.91 

0.35 

40174 

B 

0 

7 

10 

0.28 

0.31 

0.92 

-0.23 

40174 

C 

0 

2 

3 

-0.73 

1.91 

0.86 

-0.29 

40174 

D 

0 

2 

3 

0.56 

1.66 

2.44 

-0.07 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40175 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40175 

A 

1 

38 

69 

1.28 

0.20 

0.70 

0.62 

40175 

B 

0 

11 

20 

-0.58 

0.20 

0.48 

-0.36 

40175 

C 

0 

3 

5 

-0.74 

0.80 

0.61 

-0.20 

40175 

D 

0 

3 

5 

-2.39 

1.56 

0.31 

-0.44 

40176 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.03 

40176 

A 

1 

37 

76 

1.17 

0.22 

0.93 

0.57 

40176 

B 

0 

4 

8 

-0.72 

0.31 

0.42 

-0.24 

40176 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40176 

D 

0 

8 

16 

-1.25 

0.72 

0.56 

-0.49 

40177 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

40177 

A 

1 

23 

45 

1.94 

0.32 

0.83 

0.56 

40177 

B 

0 

9 

18 

0.55 

0.46 

1.39 

-0.13 

40177 

C 

0 

14 

27 

0.03 

0.25 

0.62 

-0.37 

40177 

D 

0 

5 

10 

-0.08 

0.54 

0.58 

-0.22 

40178 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40178 

A 

1 

22 

39 

1.58 

0.21 

0.81 

0.55 

40178 

B 

0 

6 

11 

0.11 

0.40 

0.68 

-0.18 

40178 

C 

0 

13 

23 

0.06 

0.40 

0.94 

-0.31 

40178 

D 

0 

15 

27 

0.39 

0.17 

0.73 

-0.18 

40179 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40179 

A 

1 

39 

70 

1.18 

0.22 

0.93 

0.40 

40179 

B 

0 

11 

20 

0.44 

0.29 

1.45 

-0.13 

40179 

C 

0 

3 

5 

-1.32 

0.33 

0.19 

-0.35 

40179 

D 

0 

3 

5 

-0.61 

0.96 

0.80 

-0.24 

40180 

* 

-1 

4828 

99 

1.01 

0.02 

0.00 

0.07 

40180 

A 

1 

21 

38 

0.91 

0.22 

0.96 

0.38 

40180 

B 

0 

8 

14 

0.45 

0.40 

1.48 

0.08 

40180 

C 

0 

21 

38 

-0.12 

0.20 

0.79 

-0.15 

40180 

D 

0 

6 

11 

-1.77 

1.18 

0.77 

-0.45 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40181 

* 

-1 

4611 

94 

0.99 

0.02 

0.00 

-0.01 

40181 

A 

1 

180 

66 

1.35 

0.07 

1.10 

0.41 

40181 

B 

0 

55 

20 

0.62 

0.11 

1.04 

-0.22 

40181 

C 

0 

33 

12 

0.30 

0.18 

0.87 

-0.27 

40181 

D 

0 

5 

2 

0.03 

0.26 

0.46 

-0.14 

40182 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.02 

40182 

A 

1 

19 

32 

1.60 

0.34 

1.11 

0.37 

40182 

B 

0 

4 

7 

1.20 

1.14 

7.40 

0.07 

40182 

C 

0 

13 

22 

0.46 

0.24 

0.93 

-0.12 

40182 

D 

0 

24 

40 

0.27 

0.29 

0.87 

-0.29 

40183 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

40183 

A 

1 

35 

60 

1.26 

0.21 

1.23 

0.45 

40183 

B 

0 

4 

7 

0.06 

0.66 

0.80 

-0.17 

40183 

C 

0 

10 

17 

0.52 

0.22 

1.01 

-0.11 

40183 

D 

0 

9 

16 

-0.26 

0.30 

0.55 

-0.37 

40184 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.01 

40184 

A 

1 

8 

13 

2.05 

0.54 

0.99 

0.35 

40184 

B 

0 

15 

25 

0.71 

0.29 

1.01 

-0.10 

40184 

C 

0 

19 

32 

1.18 

0.32 

2.33 

0.14 

40184 

D 

0 

18 

30 

0.35 

0.15 

0.49 

-0.30 

40185 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40185 

A 

1 

34 

61 

1.10 

0.23 

1.06 

0.49 

40185 

B 

0 

5 

9 

-0.28 

0.51 

0.82 

-0.21 

40185 

C 

0 

7 

13 

-0.30 

0.33 

0.63 

-0.25 

40185 

D 

0 

10 

18 

-0.15 

0.24 

0.74 

-0.26 

40186 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.00 

40186 

A 

1 

16 

26 

1.52 

0.28 

1.21 

0.25 

40186 

B 

0 

15 

24 

1.35 

0.16 

1.30 

0.16 

40186 

C 

0 

11 

18 

1.25 

0.32 

1.55 

0.09 

40186 

D 

0 

20 

32 

0.25 

0.29 

0.67 

-0.45 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40187 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.05 

40187 

A 

1 

29 

52 

1.03 

0.18 

0.92 

0.52 

40187 

B 

0 

9 

16 

-0.35 

0.41 

0.78 

-0.30 

40187 

C 

0 

11 

20 

0.11 

0.30 

1.12 

-0.15 

40187 

D 

0 

7 

13 

-0.38 

0.30 

0.58 

-0.27 

40188 

* 

-1 

4828 

99 

1.01 

0.02 

0.00 

0.06 

40188 

A 

1 

21 

38 

1.07 

0.34 

1.55 

0.38 

40188 

B 

0 

9 

16 

0.00 

0.52 

1.17 

-0.10 

40188 

C 

0 

17 

30 

-0.17 

0.31 

0.89 

-0.22 

40188 

D 

0 

9 

16 

-0.15 

0.46 

0.87 

-0.14 

40189 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40189 

A 

1 

44 

79 

1.20 

0.19 

0.71 

0.57 

40189 

B 

0 

7 

13 

-0.82 

0.42 

0.50 

-0.43 

40189 

C 

0 

1 

2 

-1.76 

0.00 

0.12 

-0.24 

40189 

D 

0 

4 

7 

-0.38 

0.11 

0.50 

-0.23 

40190 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40190 

A 

1 

35 

64 

1.32 

0.18 

0.93 

0.46 

40190 

B 

0 

4 

7 

-0.27 

0.31 

0.41 

-0.28 

40190 

C 

0 

9 

16 

0.59 

0.44 

1.86 

-0.12 

40190 

D 

0 

7 

13 

-0.10 

0.37 

0.63 

-0.32 

40191 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.01 

40191 

A 

1 

46 

79 

1.20 

0.18 

0.90 

0.48 

40191 

B 

0 

3 

5 

-0.04 

0.19 

0.61 

-0.17 

40191 

C 

0 

4 

7 

-0.48 

0.36 

0.46 

-0.29 

40191 

D 

0 

5 

9 

-0.36 

0.28 

0.50 

-0.30 

40192 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.04 

40192 

A 

1 

31 

53 

1.26 

0.23 

0.93 

0.51 

40192 

B 

0 

9 

16 

-0.17 

0.26 

0.68 

-0.23 

40192 

C 

0 

7 

12 

0.16 

0.38 

0.98 

-0.11 

40192 

D 

0 

11 

19 

-0.42 

0.46 

0.73 

-0.35 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40193 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.01 

40193 

A 

1 

43 

73 

1.30 

0.18 

0.88 

0.49 

40193 

B 

0 

3 

5 

0.17 

0.65 

0.99 

-0.11 

40193 

C 

0 

10 

17 

0.04 

0.33 

0.93 

-0.26 

40193 

D 

0 

3 

5 

-1.90 

1.34 

0.35 

-0.44 

40194 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40194 

A 

1 

24 

44 

1.31 

0.26 

1.06 

0.40 

40194 

B 

0 

7 

13 

1.09 

0.38 

2.11 

0.11 

40194 

C 

0 

9 

16 

0.58 

0.33 

1.32 

-0.06 

40194 

D 

0 

15 

27 

-0.22 

0.23 

0.58 

-0.47 

40195 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.03 

40195 

A 

1 

34 

71 

1.18 

0.23 

0.85 

0.54 

40195 

B 

0 

2 

4 

0.51 

1.00 

1.91 

-0.02 

40195 

C 

0 

3 

6 

-1.03 

1.06 

0.73 

-0.29 

40195 

D 

0 

9 

19 

-0.70 

0.28 

0.45 

-0.44 

40196 

* 

-1 

4813 

99 

1.00 

0.02 

0.00 

0.01 

40196 

A 

1 

47 

66 

1.05 

0.13 

1.11 

0.24 

40196 

B 

0 

7 

10 

0.69 

0.36 

1.52 

-0.08 

40196 

C 

0 

4 

6 

0.34 

0.52 

0.99 

-0.16 

40196 

D 

0 

13 

18 

0.64 

0.17 

1.05 

-0.14 

40197 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

40197 

A 

1 

40 

69 

1.29 

0.18 

0.71 

0.61 

40197 

B 

0 

10 

17 

-0.65 

0.23 

0.42 

-0.47 

40197 

C 

0 

5 

9 

-0.15 

0.69 

1.27 

-0.20 

40197 

D 

0 

3 

5 

-0.50 

0.30 

0.42 

-0.21 

40198 

* 

-1 

4814 

99 

1.00 

0.02 

0.00 

-0.01 

40198 

A 

1 

39 

56 

1.48 

0.21 

1.07 

0.33 

40198 

B 

0 

8 

11 

0.72 

0.38 

1.60 

-0.11 

40198 

C 

0 

9 

13 

0.89 

0.41 

1.91 

-0.07 

40198 

D 

0 

14 

20 

0.43 

0.27 

0.97 

-0.27 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40199 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.01 

40199 

A 

1 

34 

71 

1.37 

0.20 

0.84 

0.54 

40199 

B 

0 

1 

2 

1.23 

0.00 

1.93 

0.04 

40199 

C 

0 

8 

17 

-0.45 

0.38 

0.59 

-0.44 

40199 

D 

0 

5 

10 

-0.30 

0.65 

1.16 

-0.30 

40200 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.04 

40200 

A 

1 

33 

55 

1.10 

0.22 

0.93 

0.50 

40200 

B 

0 

7 

12 

-0.05 

0.27 

0.76 

-0.18 

40200 

C 

0 

4 

7 

0.57 

0.25 

1.25 

0.01 

40200 

D 

0 

16 

27 

-0.34 

0.19 

0.59 

-0.44 

40201 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.04 

40201 

A 

1 

27 

47 

1.34 

0.17 

0.87 

0.48 

40201 

B 

0 

16 

28 

0.56 

0.22 

1.13 

-0.01 

40201 

C 

0 

5 

9 

-0.23 

0.66 

0.83 

-0.17 

40201 

D 

0 

10 

17 

-0.98 

0.65 

0.45 

-0.49 

40202 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.04 

40202 

A 

1 

47 

78 

0.61 

0.16 

1.14 

0.16 

40202 

B 

0 

7 

12 

1.01 

0.33 

3.02 

0.14 

40202 

C 

0 

3 

5 

-0.40 

0.63 

0.67 

-0.16 

40202 

D 

0 

3 

5 

-1.49 

1.85 

1.32 

-0.35 

40203 

* 

-1 

4838 

99 

1.00 

0.02 

0.00 

0.00 

40203 

A 

1 

21 

46 

1.89 

0.18 

0.60 

0.67 

40203 

B 

0 

5 

11 

0.68 

0.38 

0.84 

-0.10 

40203 

C 

0 

12 

26 

0.53 

0.21 

0.70 

-0.25 

40203 

D 

0 

8 

17 

-0.29 

0.39 

0.37 

-0.51 

40204 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40204 

A 

1 

34 

63 

1.12 

0.21 

1.29 

0.24 

40204 

B 

0 

8 

15 

0.37 

0.33 

0.96 

-0.20 

40204 

C 

0 

9 

17 

0.76 

0.30 

1.35 

-0.06 

40204 

D 

0 

3 

6 

0.41 

0.21 

0.74 

-0.11 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40205 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40205 

A 

1 

30 

55 

1.09 

0.14 

0.86 

0.49 

40205 

B 

0 

12 

22 

0.40 

0.17 

0.91 

-0.13 

40205 

C 

0 

5 

9 

-0.17 

0.45 

0.66 

-0.26 

40205 

D 

0 

8 

15 

-0.13 

0.50 

0.72 

-0.32 

40206 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.03 

40206 

A 

1 

23 

43 

1.15 

0.29 

1.56 

0.35 

40206 

B 

0 

18 

34 

0.33 

0.20 

0.89 

-0.17 

40206 

C 

0 

3 

6 

0.28 

0.55 

0.89 

-0.07 

40206 

D 

0 

9 

17 

0.02 

0.51 

1.08 

-0.21 

40207 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.01 

40207 

A 

1 

37 

64 

1.09 

0.17 

1.11 

0.27 

40207 

B 

0 

8 

14 

0.88 

0.45 

2.16 

0.00 

40207 

C 

0 

3 

5 

-0.75 

0.33 

0.26 

-0.35 

40207 

D 

0 

10 

17 

0.53 

0.32 

1.41 

-0.14 

40208 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40208 

A 

1 

28 

52 

1.12 

0.27 

1.14 

0.40 

40208 

B 

0 

5 

9 

-0.04 

0.30 

0.68 

-0.12 

40208 

C 

0 

11 

20 

0.51 

0.41 

2.31 

-0.01 

40208 

D 

0 

10 

19 

-0.84 

0.53 

0.57 

-0.42 

40209 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

40209 

A 

1 

30 

59 

1.32 

0.24 

1.04 

0.37 

40209 

B 

0 

10 

20 

0.53 

0.36 

1.70 

-0.16 

40209 

C 

0 

2 

4 

0.44 

0.41 

0.80 

-0.08 

40209 

D 

0 

9 

18 

0.22 

0.25 

0.76 

-0.27 

40210 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.01 

40210 

A 

1 

34 

56 

1.32 

0.20 

1.02 

0.43 

40210 

B 

0 

4 

7 

0.85 

0.22 

1.16 

-0.01 

40210 

C 

0 

2 

3 

0.41 

0.29 

0.73 

-0.08 

40210 

D 

0 

21 

34 

0.23 

0.20 

0.91 

-0.41 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40211 

* 

-1 

4632 

95 

0.98 

0.02 

0.00 

-0.05 

40211 

A 

1 

92 

37 

1.91 

0.11 

1.08 

0.42 

40211 

B 

0 

48 

19 

0.90 

0.11 

0.78 

-0.17 

40211 

C 

0 

94 

37 

1.09 

0.10 

1.13 

-0.14 

40211 

D 

0 

18 

7 

0.24 

0.26 

0.52 

-0.27 

40212 

* 

-1 

4817 

99 

1.00 

0.02 

0.00 

0.03 

40212 

A 

1 

21 

31 

1.36 

0.31 

1.21 

0.40 

40212 

B 

0 

5 

7 

0.60 

0.45 

1.33 

-0.02 

40212 

C 

0 

21 

31 

0.24 

0.17 

0.77 

-0.26 

40212 

D 

0 

20 

30 

0.44 

0.21 

1.07 

-0.13 

40213 

* 

-1 

4827 

99 

1.01 

0.02 

0.00 

0.05 

40213 

A 

1 

25 

44 

0.79 

0.23 

1.25 

0.32 

40213 

B 

0 

10 

18 

0.43 

0.23 

1.18 

0.03 

40213 

C 

0 

9 

16 

0.19 

0.29 

1.00 

-0.06 

40213 

D 

0 

13 

23 

-0.42 

0.42 

0.73 

-0.35 

40214 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40214 

A 

1 

6 

11 

2.19 

0.83 

1.34 

0.39 

40214 

B 

0 

26 

46 

0.64 

0.24 

1.82 

-0.01 

40214 

C 

0 

8 

14 

0.31 

0.37 

0.71 

-0.11 

40214 

D 

0 

17 

30 

0.33 

0.27 

0.79 

-0.16 

40215 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.05 

40215 

A 

1 

27 

48 

1.08 

0.27 

1.21 

0.49 

40215 

B 

0 

4 

7 

0.22 

0.55 

1.22 

-0.05 

40215 

C 

0 

8 

14 

-0.35 

0.22 

0.55 

-0.26 

40215 

D 

0 

17 

30 

-0.12 

0.19 

0.75 

-0.30 

40216 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40216 

A 

1 

10 

18 

2.24 

0.54 

0.75 

0.53 

40216 

B 

0 

29 

52 

0.26 

0.20 

1.00 

-0.17 

40216 

C 

0 

11 

20 

-0.19 

0.46 

0.97 

-0.23 

40216 

D 

0 

6 

11 

0.11 

0.53 

0.77 

-0.09 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40217 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40217 

A 

1 

7 

13 

2.06 

0.48 

0.92 

0.41 

40217 

B 

0 

4 

7 

-0.13 

0.60 

0.44 

-0.20 

40217 

C 

0 

37 

66 

0.65 

0.18 

1.01 

-0.10 

40217 

D 

0 

8 

14 

0.42 

0.40 

0.77 

-0.11 

40218 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

40218 

A 

1 

6 

12 

2.63 

0.76 

0.93 

0.50 

40218 

B 

0 

26 

53 

0.62 

0.22 

0.75 

-0.10 

40218 

C 

0 

7 

14 

0.15 

0.31 

0.41 

-0.17 

40218 

D 

0 

10 

20 

0.35 

0.43 

0.77 

-0.14 

40219 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.05 

40219 

A 

1 

16 

29 

1.24 

0.37 

1.02 

0.41 

40219 

B 

0 

26 

46 

0.16 

0.19 

1.02 

-0.23 

40219 

C 

0 

3 

5 

0.05 

0.12 

0.61 

-0.08 

40219 

D 

0 

11 

20 

0.13 

0.31 

1.03 

-0.13 

40220 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

40220 

A 

1 

10 

18 

1.85 

0.65 

1.34 

0.42 

40220 

B 

0 

34 

60 

0.16 

0.19 

0.87 

-0.35 

40220 

C 

0 

2 

4 

1.19 

0.98 

2.01 

0.08 

40220 

D 

0 

11 

19 

0.53 

0.29 

1.07 

-0.01 

40221 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.05 

40221 

A 

1 

5 

9 

0.31 

0.36 

2.23 

-0.04 

40221 

B 

0 

34 

63 

0.61 

0.18 

1.40 

0.20 

40221 

C 

0 

4 

7 

0.55 

0.75 

1.52 

0.03 

40221 

D 

0 

11 

20 

-0.04 

0.34 

0.72 

-0.23 

40222 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

-0.01 

40222 

A 

1 

22 

39 

1.62 

0.34 

1.53 

0.31 

40222 

B 

0 

9 

16 

0.91 

0.38 

1.48 

-0.07 

40222 

C 

0 

10 

18 

0.65 

0.34 

1.05 

-0.16 

40222 

D 

0 

16 

28 

0.81 

0.23 

1.04 

-0.14 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40223 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40223 

A 

1 

18 

32 

1.79 

0.41 

1.39 

0.45 

40223 

B 

0 

6 

11 

-0.12 

0.25 

0.43 

-0.16 

40223 

C 

0 

11 

19 

0.05 

0.32 

0.77 

-0.18 

40223 

D 

0 

22 

39 

0.26 

0.37 

1.55 

-0.19 

40224 

* 

-1 

4606 

94 

0.97 

0.02 

0.00 

-0.08 

40224 

A 

1 

225 

81 

1.56 

0.07 

1.04 

0.30 

40224 

B 

0 

21 

8 

0.84 

0.19 

1.12 

-0.14 

40224 

C 

0 

28 

10 

0.74 

0.19 

1.24 

-0.20 

40224 

D 

0 

4 

1 

-0.21 

0.41 

0.37 

-0.17 

40225 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40225 

A 

1 

37 

66 

0.97 

0.19 

1.24 

0.42 

40225 

B 

0 

11 

20 

-0.02 

0.20 

0.73 

-0.29 

40225 

C 

0 

2 

4 

0.90 

0.01 

1.55 

0.04 

40225 

D 

0 

6 

11 

-0.34 

0.32 

0.55 

-0.30 

40226 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.02 

40226 

A 

1 

34 

71 

1.04 

0.19 

1.47 

0.39 

40226 

B 

0 

3 

6 

0.82 

0.22 

1.34 

0.02 

40226 

C 

0 

5 

10 

0.11 

0.19 

0.68 

-0.18 

40226 

D 

0 

6 

13 

-0.50 

0.63 

0.63 

-0.39 

40227 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40227 

A 

1 

26 

48 

1.28 

0.25 

1.83 

0.44 

40227 

B 

0 

7 

13 

0.34 

0.68 

2.28 

-0.09 

40227 

C 

0 

2 

4 

0.67 

0.93 

1.39 

0.00 

40227 

D 

0 

19 

35 

-0.06 

0.22 

0.67 

-0.39 

40228 

* 

-1 

4598 

94 

0.97 

0.02 

0.00 

-0.09 

40228 

A 

1 

261 

91 

1.51 

0.08 

1.08 

0.14 

40228 

B 

0 

4 

1 

0.88 

0.43 

1.23 

-0.06 

40228 

C 

0 

21 

7 

0.92 

0.27 

1.82 

-0.12 

40228 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40229 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40229 

A 

1 

51 

89 

0.73 

0.14 

0.91 

0.26 

40229 

B 

0 

1 

2 

-1.09 

0.00 

0.25 

-0.22 

40229 

C 

0 

5 

9 

0.05 

0.70 

1.85 

-0.17 

40229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40230 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.04 

40230 

A 

1 

53 

91 

0.65 

0.20 

0.96 

0.34 

40230 

B 

0 

3 

5 

-1.18 

0.38 

0.41 

-0.27 

40230 

C 

0 

1 

2 

-0.40 

0.00 

0.80 

-0.08 

40230 

D 

0 

1 

2 

-1.69 

0.00 

0.22 

-0.20 

40231 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

40231 

A 

1 

35 

61 

0.93 

0.18 

0.95 

0.42 

40231 

B 

0 

5 

9 

-0.65 

0.35 

0.43 

-0.33 

40231 

C 

0 

4 

7 

-0.12 

0.77 

1.48 

-0.16 

40231 

D 

0 

13 

23 

0.20 

0.26 

1.25 

-0.17 

40232 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.00 

40232 

A 

1 

42 

74 

1.28 

0.17 

0.93 

0.48 

40232 

B 

0 

4 

7 

0.19 

0.15 

0.64 

-0.18 

40232 

C 

0 

6 

11 

-0.09 

0.37 

0.61 

-0.30 

40232 

D 

0 

5 

9 

-0.05 

0.46 

0.70 

-0.26 

40233 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

40233 

A 

1 

22 

44 

1.50 

0.32 

1.20 

0.40 

40233 

B 

0 

5 

10 

0.20 

0.42 

0.65 

-0.20 

40233 

C 

0 

9 

18 

0.35 

0.26 

0.73 

-0.22 

40233 

D 

0 

14 

28 

0.67 

0.24 

1.15 

-0.13 

40234 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40234 

A 

1 

38 

68 

1.26 

0.12 

0.76 

0.56 

40234 

B 

0 

4 

7 

1.05 

0.44 

1.77 

0.05 

40234 

C 

0 

4 

7 

-0.23 

0.52 

0.58 

-0.28 

40234 

D 

0 

10 

18 

-0.38 

0.36 

0.49 

-0.53 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40235 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.02 

40235 

A 

1 

35 

69 

1.04 

0.18 

1.02 

0.41 

40235 

B 

0 

4 

8 

-0.44 

0.40 

0.53 

-0.29 

40235 

C 

0 

7 

14 

0.76 

0.40 

1.95 

0.01 

40235 

D 

0 

5 

10 

-0.67 

0.22 

0.35 

-0.39 

40236 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40236 

A 

1 

44 

79 

0.97 

0.21 

0.85 

0.45 

40236 

B 

0 

8 

14 

-0.28 

0.34 

0.93 

-0.27 

40236 

C 

0 

2 

4 

-1.03 

0.20 

0.31 

-0.23 

40236 

D 

0 

2 

4 

-1.22 

0.03 

0.25 

-0.25 

40237 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.02 

40237 

A 

1 

43 

72 

0.99 

0.14 

1.06 

0.32 

40237 

B 

0 

6 

10 

0.15 

0.53 

0.99 

-0.22 

40237 

C 

0 

5 

8 

0.53 

0.50 

1.41 

-0.08 

40237 

D 

0 

6 

10 

0.22 

0.27 

0.79 

-0.19 

40238 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

40238 

A 

1 

46 

81 

1.10 

0.16 

0.86 

0.38 

40238 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40238 

C 

0 

2 

4 

-0.27 

1.41 

0.96 

-0.19 

40238 

D 

0 

9 

16 

0.03 

0.35 

1.07 

-0.32 

40239 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.03 

40239 

A 

1 

46 

78 

0.92 

0.18 

1.40 

0.42 

40239 

B 

0 

2 

3 

-0.67 

0.18 

0.38 

-0.20 

40239 

C 

0 

9 

15 

-0.37 

0.30 

0.69 

-0.34 

40239 

D 

0 

2 

3 

-0.03 

0.17 

0.73 

-0.10 

40240 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.01 

40240 

A 

1 

45 

70 

1.10 

0.12 

1.00 

0.35 

40240 

B 

0 

5 

8 

0.43 

0.32 

0.85 

-0.17 

40240 

C 

0 

3 

5 

1.10 

0.21 

1.42 

0.05 

40240 

D 

0 

11 

17 

0.32 

0.20 

0.73 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40241 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40241 

A 

1 

34 

60 

1.33 

0.23 

0.88 

0.59 

40241 

B 

0 

9 

16 

-0.49 

0.23 

0.50 

-0.34 

40241 

C 

0 

11 

19 

-0.21 

0.26 

0.71 

-0.29 

40241 

D 

0 

3 

5 

-0.73 

0.71 

0.49 

-0.23 

40242 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40242 

A 

1 

43 

75 

0.90 

0.13 

0.79 

0.54 

40242 

B 

0 

3 

5 

-0.38 

0.22 

0.49 

-0.23 

40242 

C 

0 

5 

9 

-0.38 

0.49 

0.69 

-0.30 

40242 

D 

0 

6 

11 

-0.33 

0.45 

0.76 

-0.31 

40243 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40243 

A 

1 

25 

43 

1.39 

0.22 

0.84 

0.53 

40243 

B 

0 

21 

36 

0.25 

0.23 

1.10 

-0.22 

40243 

C 

0 

6 

10 

-0.19 

0.25 

0.48 

-0.22 

40243 

D 

0 

6 

10 

-0.50 

0.56 

0.57 

-0.30 

40244 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

-0.02 

40244 

A 

1 

41 

63 

1.73 

0.17 

0.75 

0.57 

40244 

B 

0 

5 

8 

-0.21 

0.25 

0.34 

-0.33 

40244 

C 

0 

17 

26 

0.43 

0.24 

1.00 

-0.37 

40244 

D 

0 

2 

3 

0.28 

0.44 

0.55 

-0.13 

40245 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

40245 

A 

1 

47 

82 

1.15 

0.20 

0.92 

0.42 

40245 

B 

0 

4 

7 

-0.74 

0.66 

0.58 

-0.31 

40245 

C 

0 

4 

7 

0.06 

0.48 

1.03 

-0.16 

40245 

D 

0 

2 

4 

-0.66 

0.37 

0.38 

-0.21 

40246 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40246 

A 

1 

48 

84 

0.91 

0.17 

0.91 

0.51 

40246 

B 

0 

2 

4 

-1.06 

0.66 

0.36 

-0.25 

40246 

C 

0 

3 

5 

-1.05 

0.45 

0.35 

-0.31 

40246 

D 

0 

4 

7 

-0.64 

0.18 

0.47 

-0.27 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40247 

* 

-1 

4612 

94 

0.98 

0.02 

0.00 

-0.07 

40247 

A 

1 

247 

91 

1.53 

0.07 

0.98 

0.41 

40247 

B 

0 

20 

7 

-0.06 

0.20 

0.57 

-0.34 

40247 

C 

0 

4 

1 

-0.17 

0.38 

0.46 

-0.16 

40247 

D 

0 

1 

0 

-1.69 

0.00 

0.08 

-0.16 

40248 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40248 

A 

1 

36 

65 

1.48 

0.18 

0.72 

0.67 

40248 

B 

0 

13 

24 

-0.31 

0.24 

0.54 

-0.50 

40248 

C 

0 

5 

9 

-0.45 

0.23 

0.37 

-0.32 

40248 

D 

0 

1 

2 

-0.12 

0.00 

0.48 

-0.10 

40249 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.03 

40249 

A 

1 

41 

77 

1.16 

0.17 

0.71 

0.64 

40249 

B 

0 

7 

13 

-0.71 

0.39 

0.57 

-0.39 

40249 

C 

0 

1 

2 

-0.21 

0.00 

0.61 

-0.09 

40249 

D 

0 

4 

8 

-1.58 

0.79 

0.38 

-0.46 

40250 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40250 

A 

1 

46 

81 

0.84 

0.20 

1.13 

0.39 

40250 

B 

0 

3 

5 

-0.20 

0.38 

0.84 

-0.14 

40250 

C 

0 

3 

5 

-1.02 

0.30 

0.35 

-0.28 

40250 

D 

0 

5 

9 

-0.31 

0.36 

0.82 

-0.21 

40251 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40251 

A 

1 

48 

86 

1.09 

0.16 

0.86 

0.42 

40251 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40251 

C 

0 

2 

4 

0.63 

0.21 

1.22 

-0.04 

40251 

D 

0 

6 

11 

-0.75 

0.60 

0.60 

-0.45 

40252 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40252 

A 

1 

44 

79 

1.00 

0.22 

1.40 

0.29 

40252 

B 

0 

9 

16 

-0.16 

0.23 

0.78 

-0.30 

40252 

C 

0 

2 

4 

0.38 

0.19 

1.06 

-0.06 

40252 

D 

0 

1 

2 

0.88 

0.00 

1.72 

0.01 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40253 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

-0.02 

40253 

A 

1 

47 

96 

1.27 

0.17 

1.01 

0.18 

40253 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40253 

C 

0 

2 

4 

0.23 

0.54 

0.70 

-0.18 

40253 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40254 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40254 

A 

1 

48 

87 

1.18 

0.17 

0.90 

0.40 

40254 

B 

0 

1 

2 

-0.03 

0.00 

0.54 

-0.12 

40254 

C 

0 

3 

5 

0.22 

0.14 

0.71 

-0.16 

40254 

D 

0 

3 

5 

-0.80 

0.28 

0.27 

-0.36 

40255 

* 

-1 

4833 

99 

0.99 

0.02 

0.00 

-0.03 

40255 

A 

1 

47 

92 

1.49 

0.19 

0.94 

0.33 

40255 

B 

0 

3 

6 

-0.02 

0.15 

0.46 

-0.26 

40255 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40255 

D 

0 

1 

2 

-0.38 

0.00 

0.31 

-0.19 

40256 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40256 

A 

1 

48 

86 

1.03 

0.21 

0.70 

0.51 

40256 

B 

0 

2 

4 

-1.83 

0.14 

0.16 

-0.28 

40256 

C 

0 

3 

5 

-0.93 

1.18 

0.90 

-0.22 

40256 

D 

0 

3 

5 

-1.80 

1.60 

0.62 

-0.34 

40257 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.03 

40257 

A 

1 

35 

73 

0.83 

0.23 

1.00 

0.28 

40257 

B 

0 

4 

8 

1.05 

0.44 

3.03 

0.10 

40257 

C 

0 

7 

15 

-0.54 

0.44 

0.74 

-0.35 

40257 

D 

0 

2 

4 

-0.32 

0.53 

0.64 

-0.14 

40258 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40258 

A 

1 

54 

98 

0.92 

0.21 

1.01 

0.12 

40258 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40258 

C 

0 

1 

2 

-0.41 

0.00 

0.58 

-0.12 

40258 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40259 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.03 

40259 

A 

1 

52 

98 

0.63 

0.16 

1.03 

0.06 

40259 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40259 

C 

0 

1 

2 

0.13 

0.00 

1.00 

-0.06 

40259 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40260 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

40260 

A 

1 

53 

91 

0.82 

0.14 

1.00 

0.31 

40260 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40260 

C 

0 

4 

7 

-0.30 

0.23 

0.58 

-0.27 

40260 

D 

0 

1 

2 

-0.48 

0.00 

0.44 

-0.15 

40261 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

40261 

A 

1 

44 

77 

1.11 

0.20 

1.14 

0.28 

40261 

B 

0 

2 

4 

-0.16 

0.68 

0.61 

-0.16 

40261 

C 

0 

6 

11 

0.02 

0.26 

0.70 

-0.24 

40261 

D 

0 

5 

9 

0.70 

0.31 

1.42 

-0.05 

40262 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40262 

A 

1 

53 

91 

0.76 

0.20 

1.01 

0.19 

40262 

B 

0 

2 

3 

0.09 

0.98 

1.71 

-0.08 

40262 

C 

0 

1 

2 

-0.76 

0.00 

0.48 

-0.13 

40262 

D 

0 

2 

3 

-0.25 

1.94 

2.84 

-0.12 

40263 

* 

-1 

4841 

99 

1.00 

0.02 

0.00 

0.00 

40263 

A 

1 

37 

86 

1.12 

0.19 

0.95 

0.25 

40263 

B 

0 

1 

2 

1.10 

0.00 

1.71 

0.01 

40263 

C 

0 

2 

5 

0.77 

1.23 

2.30 

-0.04 

40263 

D 

0 

3 

7 

-0.42 

0.92 

0.89 

-0.32 

40264 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

40264 

A 

1 

49 

84 

1.03 

0.16 

1.06 

0.43 

40264 

B 

0 

3 

5 

-1.14 

0.83 

0.38 

-0.38 

40264 

C 

0 

4 

7 

-0.25 

0.29 

0.60 

-0.24 

40264 

D 

0 

2 

3 

0.46 

0.38 

1.14 

-0.06 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40265 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40265 

A 

1 

43 

77 

0.87 

0.22 

1.33 

0.31 

40265 

B 

0 

5 

9 

-0.02 

0.34 

0.92 

-0.12 

40265 

C 

0 

4 

7 

0.72 

0.66 

2.44 

0.02 

40265 

D 

0 

4 

7 

-1.68 

1.41 

0.85 

-0.39 

40266 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.02 

40266 

A 

1 

39 

81 

1.02 

0.19 

0.98 

0.41 

40266 

B 

0 

1 

2 

1.10 

0.00 

2.08 

0.04 

40266 

C 

0 

1 

2 

0.44 

0.00 

1.07 

-0.04 

40266 

D 

0 

7 

15 

-0.59 

0.41 

0.60 

-0.46 

40267 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.03 

40267 

A 

1 

39 

66 

0.97 

0.15 

0.97 

0.45 

40267 

B 

0 

12 

20 

0.15 

0.26 

1.05 

-0.24 

40267 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40267 

D 

0 

8 

14 

-0.21 

0.27 

0.63 

-0.33 

40268 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40268 

A 

1 

42 

74 

1.04 

0.16 

0.88 

0.41 

40268 

B 

0 

1 

2 

-0.31 

0.00 

0.43 

-0.13 

40268 

C 

0 

4 

7 

0.47 

0.45 

1.36 

-0.07 

40268 

D 

0 

10 

18 

-0.16 

0.34 

0.78 

-0.39 

40269 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.01 

40269 

A 

1 

51 

86 

1.02 

0.15 

0.95 

0.34 

40269 

B 

0 

1 

2 

0.42 

0.00 

0.96 

-0.05 

40269 

C 

0 

3 

5 

-0.22 

0.92 

0.87 

-0.22 

40269 

D 

0 

4 

7 

-0.16 

0.62 

1.05 

-0.25 

40270 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40270 

A 

1 

51 

91 

0.92 

0.20 

0.86 

0.41 

40270 

B 

0 

2 

4 

-0.95 

0.73 

0.51 

-0.22 

40270 

C 

0 

2 

4 

-1.75 

0.75 

0.23 

-0.32 

40270 

D 

0 

1 

2 

-0.78 

0.00 

0.47 

-0.14 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40271 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40271 

A 

1 

47 

85 

0.81 

0.13 

0.98 

0.31 

40271 

B 

0 

2 

4 

-0.34 

0.67 

0.57 

-0.22 

40271 

C 

0 

3 

5 

0.59 

0.48 

1.51 

-0.03 

40271 

D 

0 

3 

5 

-0.34 

0.47 

0.59 

-0.28 

40272 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

40272 

A 

1 

55 

95 

0.71 

0.17 

1.10 

0.02 

40272 

B 

0 

1 

2 

0.42 

0.00 

1.30 

-0.03 

40272 

C 

0 

2 

3 

0.70 

0.39 

1.85 

0.00 

40272 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40273 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40273 

A 

1 

47 

85 

1.09 

0.21 

1.02 

0.26 

40273 

B 

0 

1 

2 

0.71 

0.00 

1.33 

-0.02 

40273 

C 

0 

2 

4 

0.36 

0.95 

1.39 

-0.08 

40273 

D 

0 

5 

9 

-0.16 

0.47 

0.81 

-0.25 

40274 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.00 

40274 

A 

1 

46 

85 

1.01 

0.19 

1.18 

0.11 

40274 

B 

0 

1 

2 

1.69 

0.00 

3.27 

0.08 

40274 

C 

0 

2 

4 

-0.10 

0.30 

0.57 

-0.16 

40274 

D 

0 

5 

9 

0.66 

0.65 

2.76 

-0.07 

40275 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40275 

A 

1 

50 

89 

1.07 

0.23 

0.98 

0.30 

40275 

B 

0 

1 

2 

0.23 

0.00 

1.11 

-0.05 

40275 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40275 

D 

0 

5 

9 

-0.67 

0.43 

0.62 

-0.30 

40276 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40276 

A 

1 

44 

80 

0.87 

0.20 

0.98 

0.21 

40276 

B 

0 

2 

4 

1.13 

0.37 

2.44 

0.06 

40276 

C 

0 

3 

5 

0.61 

1.24 

3.15 

-0.02 

40276 

D 

0 

6 

11 

-0.40 

0.42 

0.74 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40277 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.00 

40277 

A 

1 

49 

88 

1.15 

0.16 

0.91 

0.37 

40277 

B 

0 

1 

2 

-0.56 

0.00 

0.31 

-0.19 

40277 

C 

0 

5 

9 

-0.08 

0.23 

0.56 

-0.30 

40277 

D 

0 

1 

2 

0.13 

0.00 

0.61 

-0.10 

40278 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40278 

A 

1 

48 

87 

0.84 

0.18 

0.94 

0.31 

40278 

B 

0 

5 

9 

-0.37 

0.79 

1.32 

-0.26 

40278 

C 

0 

1 

2 

0.04 

0.00 

0.86 

-0.07 

40278 

D 

0 

1 

2 

-0.83 

0.00 

0.36 

-0.16 

40279 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

40279 

A 

1 

42 

84 

1.25 

0.19 

0.89 

0.55 

40279 

B 

0 

1 

2 

0.89 

0.00 

1.50 

0.00 

40279 

C 

0 

5 

10 

-0.83 

0.38 

0.34 

-0.34 

40279 

D 

0 

2 

4 

-3.28 

2.82 

0.39 

-0.51 

40280 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

40280 

A 

1 

52 

90 

1.02 

0.17 

0.83 

0.44 

40280 

B 

0 

1 

2 

-1.35 

0.00 

0.21 

-0.22 

40280 

C 

0 

3 

5 

-0.01 

0.40 

0.90 

-0.14 

40280 

D 

0 

2 

3 

-2.04 

0.36 

0.11 

-0.40 

40281 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.01 

40281 

A 

1 

41 

77 

1.30 

0.27 

1.00 

0.39 

40281 

B 

0 

9 

17 

-0.22 

0.50 

1.49 

-0.25 

40281 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40281 

D 

0 

3 

6 

-1.58 

2.26 

1.43 

-0.31 

40282 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

40282 

A 

1 

43 

81 

1.02 

0.16 

0.86 

0.46 

40282 

B 

0 

5 

9 

-0.64 

0.43 

0.47 

-0.38 

40282 

C 

0 

2 

4 

0.74 

0.20 

1.39 

0.00 

40282 

D 

0 

3 

6 

-0.63 

1.12 

0.75 

-0.29 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40283 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40283 

A 

1 

42 

76 

1.13 

0.18 

0.88 

0.50 

40283 

B 

0 

3 

5 

0.16 

0.45 

0.95 

-0.11 

40283 

C 

0 

2 

4 

-0.34 

0.61 

0.56 

-0.17 

40283 

D 

0 

8 

15 

-0.60 

0.46 

0.60 

-0.44 

40284 

* 

-1 

4829 

99 

1.01 

0.02 

0.00 

0.05 

40284 

A 

1 

51 

93 

0.60 

0.21 

1.11 

0.48 

40284 

B 

0 

2 

4 

-1.70 

0.95 

0.44 

-0.23 

40284 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40284 

D 

0 

2 

4 

-3.66 

2.45 

0.49 

-0.44 

40285 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40285 

A 

1 

51 

94 

0.63 

0.15 

1.07 

0.41 

40285 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40285 

C 

0 

1 

2 

1.88 

0.00 

6.57 

0.14 

40285 

D 

0 

2 

4 

-3.75 

2.06 

0.19 

-0.60 

40286 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40286 

A 

-1 

54 

100 

0.88 

0.18 

0.00 

0.00 

40286 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40286 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40286 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40287 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40287 

A 

1 

50 

91 

0.87 

0.17 

0.98 

0.44 

40287 

B 

0 

1 

2 

-2.05 

0.00 

0.10 

-0.25 

40287 

C 

0 

2 

4 

0.28 

0.40 

1.13 

-0.05 

40287 

D 

0 

2 

4 

-2.85 

3.26 

1.19 

-0.45 

40288 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40288 

A 

1 

55 

98 

0.81 

0.18 

1.03 

0.05 

40288 

B 

0 

1 

2 

0.33 

0.00 

1.26 

-0.05 

40288 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40288 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40289 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.05 

40289 

A 

-1 

51 

98 

0.55 

0.15 

0.00 

0.66 

40289 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40289 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40289 

D 

-1 

1 

2 

-6.10 

0.00 

0.00 

-0.66 

40290 

* 

-1 

4829 

99 

1.01 

0.02 

0.00 

0.05 

40290 

A 

1 

48 

87 

0.78 

0.16 

0.84 

0.66 

40290 

B 

0 

1 

2 

-2.06 

0.00 

0.12 

-0.20 

40290 

C 

0 

2 

4 

-1.03 

0.19 

0.35 

-0.16 

40290 

D 

0 

4 

7 

-3.40 

1.33 

0.39 

-0.63 

40291 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

-0.02 

40291 

A 

1 

43 

90 

1.35 

0.18 

0.87 

0.36 

40291 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40291 

C 

0 

4 

8 

0.03 

0.52 

0.70 

-0.28 

40291 

D 

0 

1 

2 

-0.76 

0.00 

0.23 

-0.23 

40292 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40292 

A 

1 

56 

98 

0.64 

0.15 

0.95 

0.23 

40292 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40292 

C 

0 

1 

2 

-1.40 

0.00 

0.23 

-0.23 

40292 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40293 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.03 

40293 

A 

1 

49 

96 

0.66 

0.17 

1.35 

0.05 

40293 

B 

0 

1 

2 

0.57 

0.00 

1.69 

-0.01 

40293 

C 

0 

1 

2 

0.14 

0.00 

1.10 

-0.06 

40293 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40294 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40294 

A 

1 

31 

55 

1.06 

0.22 

1.67 

0.24 

40294 

B 

0 

16 

29 

0.60 

0.28 

1.61 

-0.11 

40294 

C 

0 

7 

13 

0.14 

0.41 

0.87 

-0.21 

40294 

D 

0 

2 

4 

0.85 

0.23 

1.14 

0.01 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40295 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

-0.02 

40295 

A 

1 

46 

82 

1.58 

0.23 

0.84 

0.44 

40295 

B 

0 

8 

14 

-0.12 

0.25 

0.63 

-0.34 

40295 

C 

0 

1 

2 

-0.58 

0.00 

0.32 

-0.15 

40295 

D 

0 

1 

2 

-1.10 

0.00 

0.19 

-0.20 

40296 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40296 

A 

1 

49 

89 

1.21 

0.17 

0.83 

0.44 

40296 

B 

0 

4 

7 

-0.08 

0.69 

1.16 

-0.24 

40296 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40296 

D 

0 

2 

4 

-1.66 

0.52 

0.14 

-0.40 

40297 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.01 

40297 

A 

1 

47 

78 

1.23 

0.20 

0.95 

0.51 

40297 

B 

0 

12 

20 

-0.49 

0.30 

0.64 

-0.45 

40297 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40297 

D 

0 

1 

2 

-1.78 

0.00 

0.12 

-0.23 

40298 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40298 

A 

1 

46 

79 

1.05 

0.21 

1.42 

0.41 

40298 

B 

0 

10 

17 

0.23 

0.29 

1.26 

-0.11 

40298 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40298 

D 

0 

2 

3 

-5.96 

0.15 

0.00 

-0.69 

40299 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

-0.02 

40299 

A 

1 

7 

13 

3.56 

0.77 

0.66 

0.61 

40299 

B 

0 

45 

80 

0.90 

0.16 

1.03 

-0.42 

40299 

C 

0 

3 

5 

0.43 

0.32 

0.43 

-0.13 

40299 

D 

0 

1 

2 

0.53 

0.00 

0.43 

-0.06 

40300 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.02 

40300 

A 

1 

37 

74 

0.99 

0.19 

0.99 

0.37 

40300 

B 

0 

12 

24 

0.02 

0.26 

0.91 

-0.36 

40300 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40300 

D 

0 

1 

2 

0.03 

0.00 

0.66 

-0.09 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


277 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40301 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.00 

40301 

A 

1 

46 

72 

1.42 

0.18 

0.83 

0.53 

40301 

B 

0 

12 

19 

-0.41 

0.31 

0.49 

-0.47 

40301 

C 

0 

5 

8 

0.08 

0.56 

1.22 

-0.18 

40301 

D 

0 

1 

2 

0.61 

0.00 

1.00 

-0.03 

40302 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.00 

40302 

A 

1 

52 

87 

1.25 

0.16 

0.93 

0.44 

40302 

B 

0 

5 

8 

0.05 

0.27 

0.59 

-0.21 

40302 

C 

0 

2 

3 

-0.05 

0.97 

0.72 

-0.14 

40302 

D 

0 

1 

2 

-4.51 

0.00 

0.00 

-0.52 

40303 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40303 

A 

1 

47 

85 

1.13 

0.18 

0.84 

0.50 

40303 

B 

0 

2 

4 

-0.33 

0.80 

0.65 

-0.16 

40303 

C 

0 

5 

9 

-0.59 

0.35 

0.47 

-0.32 

40303 

D 

0 

1 

2 

-3.51 

0.00 

0.00 

-0.42 

40304 

* 

-1 

4815 

99 

1.00 

0.02 

0.00 

0.00 

40304 

A 

1 

58 

84 

1.36 

0.18 

0.80 

0.53 

40304 

B 

0 

7 

10 

-0.22 

0.25 

0.67 

-0.27 

40304 

C 

0 

3 

4 

-2.00 

0.50 

0.12 

-0.42 

40304 

D 

0 

1 

1 

-1.94 

0.00 

0.10 

-0.23 

40305 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40305 

A 

1 

45 

83 

0.96 

0.18 

0.90 

0.41 

40305 

B 

0 

6 

11 

-0.12 

0.35 

0.87 

-0.25 

40305 

C 

0 

3 

6 

-0.92 

0.31 

0.32 

-0.33 

40305 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40306 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.00 

40306 

A 

1 

56 

86 

1.16 

0.18 

0.93 

0.35 

40306 

B 

0 

6 

9 

-0.19 

0.59 

1.49 

-0.26 

40306 

C 

0 

2 

3 

-0.66 

0.56 

0.42 

-0.20 

40306 

D 

0 

1 

2 

-0.08 

0.00 

0.64 

-0.09 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40307 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

-0.01 

40307 

A 

1 

47 

89 

1.18 

0.23 

1.61 

0.17 

40307 

B 

0 

5 

9 

0.44 

0.40 

1.41 

-0.14 

40307 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40307 

D 

0 

1 

2 

-0.04 

0.00 

0.64 

-0.10 

40308 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40308 

A 

1 

52 

95 

0.61 

0.13 

1.02 

0.48 

40308 

B 

0 

2 

4 

-0.16 

0.33 

0.72 

-0.10 

40308 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40308 

D 

0 

1 

2 

-5.50 

0.00 

0.00 

-0.67 

40309 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40309 

A 

1 

41 

76 

1.04 

0.17 

0.90 

0.47 

40309 

B 

0 

9 

17 

-0.12 

0.33 

0.84 

-0.32 

40309 

C 

0 

2 

4 

-0.21 

0.23 

0.55 

-0.16 

40309 

D 

0 

2 

4 

-0.90 

0.86 

0.37 

-0.27 

40310 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40310 

A 

1 

49 

89 

0.71 

0.20 

1.06 

0.22 

40310 

B 

0 

2 

4 

-0.32 

1.03 

1.07 

-0.13 

40310 

C 

0 

2 

4 

-0.32 

0.28 

0.70 

-0.13 

40310 

D 

0 

2 

4 

-0.12 

0.23 

0.85 

-0.10 

40311 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

-0.01 

40311 

A 

1 

46 

84 

1.37 

0.17 

0.95 

0.45 

40311 

B 

0 

2 

4 

0.46 

0.23 

0.81 

-0.11 

40311 

C 

0 

5 

9 

-0.24 

0.46 

0.62 

-0.35 

40311 

D 

0 

2 

4 

-0.47 

0.41 

0.34 

-0.25 

40312 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

40312 

A 

1 

48 

91 

0.95 

0.19 

0.89 

0.43 

40312 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40312 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40312 

D 

0 

5 

9 

-1.13 

0.28 

0.34 

-0.43 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40313 

* 

-1 

4816 

99 

1.00 

0.02 

0.00 

0.00 

40313 

A 

1 

41 

60 

1.67 

0.18 

0.75 

0.64 

40313 

B 

0 

9 

13 

-0.45 

0.29 

0.45 

-0.42 

40313 

C 

0 

12 

18 

0.33 

0.23 

0.88 

-0.23 

40313 

D 

0 

6 

9 

-0.30 

0.30 

0.42 

-0.30 

40314 

* 

-1 

4816 

99 

0.99 

0.02 

0.00 

-0.04 

40314 

A 

1 

47 

69 

1.49 

0.19 

1.47 

0.11 

40314 

B 

0 

1 

1 

-0.31 

0.00 

0.23 

-0.17 

40314 

C 

0 

17 

25 

1.52 

0.20 

1.96 

0.06 

40314 

D 

0 

3 

4 

-0.14 

0.35 

0.31 

-0.28 

40315 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40315 

A 

1 

50 

89 

0.85 

0.14 

0.95 

0.39 

40315 

B 

0 

1 

2 

-0.59 

0.00 

0.41 

-0.17 

40315 

C 

0 

2 

4 

-0.72 

0.85 

0.49 

-0.26 

40315 

D 

0 

3 

5 

-0.27 

0.37 

0.65 

-0.22 

40316 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.00 

40316 

A 

1 

40 

67 

1.29 

0.22 

1.01 

0.34 

40316 

B 

0 

1 

2 

1.92 

0.00 

3.46 

0.09 

40316 

C 

0 

11 

18 

0.56 

0.36 

1.42 

-0.14 

40316 

D 

0 

8 

13 

-0.25 

0.25 

0.49 

-0.35 

40317 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.03 

40317 

A 

1 

42 

81 

0.93 

0.17 

0.83 

0.52 

40317 

B 

0 

2 

4 

-0.46 

0.83 

0.68 

-0.18 

40317 

C 

0 

3 

6 

-0.87 

0.18 

0.34 

-0.31 

40317 

D 

0 

5 

10 

-0.57 

0.16 

0.47 

-0.33 

40318 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.05 

40318 

A 

1 

35 

73 

0.70 

0.17 

1.08 

0.51 

40318 

B 

0 

1 

2 

-0.58 

0.00 

0.50 

-0.11 

40318 

C 

0 

5 

10 

0.03 

0.26 

1.03 

-0.09 

40318 

D 

0 

7 

15 

-1.16 

0.43 

0.42 

-0.52 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40319 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

40319 

A 

1 

37 

73 

1.39 

0.23 

0.97 

0.41 

40319 

B 

0 

4 

8 

0.09 

0.46 

0.78 

-0.20 

40319 

C 

0 

7 

14 

0.36 

0.33 

1.03 

-0.19 

40319 

D 

0 

3 

6 

-0.51 

0.93 

0.55 

-0.28 

40320 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

-0.01 

40320 

A 

1 

43 

78 

1.42 

0.18 

0.85 

0.46 

40320 

B 

0 

1 

2 

-1.01 

0.00 

0.18 

-0.22 

40320 

C 

0 

8 

15 

0.19 

0.19 

0.68 

-0.29 

40320 

D 

0 

3 

5 

-0.35 

1.37 

1.59 

-0.27 

40321 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.02 

40321 

A 

1 

34 

71 

1.19 

0.21 

1.03 

0.48 

40321 

B 

0 

1 

2 

0.49 

0.00 

0.92 

-0.03 

40321 

C 

0 

9 

19 

-0.20 

0.24 

0.63 

-0.31 

40321 

D 

0 

4 

8 

-0.85 

1.44 

1.15 

-0.33 

40322 

* 

-1 

4590 

94 

0.97 

0.02 

0.00 

-0.10 

40322 

A 

1 

266 

90 

1.62 

0.07 

0.98 

0.28 

40322 

B 

0 

8 

3 

0.24 

0.32 

0.65 

-0.17 

40322 

C 

0 

16 

5 

0.76 

0.25 

1.16 

-0.15 

40322 

D 

0 

4 

1 

-0.31 

0.60 

0.51 

-0.18 

40323 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.03 

40323 

A 

1 

36 

68 

0.96 

0.16 

0.80 

0.46 

40323 

B 

0 

8 

15 

0.06 

0.57 

1.79 

-0.20 

40323 

C 

0 

3 

6 

-0.13 

0.61 

0.81 

-0.16 

40323 

D 

0 

6 

11 

-0.49 

0.20 

0.46 

-0.34 

40324 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

40324 

A 

1 

40 

78 

1.32 

0.21 

0.80 

0.47 

40324 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40324 

C 

0 

2 

4 

0.94 

1.38 

3.37 

0.00 

40324 

D 

0 

9 

18 

-0.68 

0.44 

0.60 

-0.51 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40325 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

40325 

A 

1 

40 

75 

1.02 

0.22 

1.01 

0.36 

40325 

B 

0 

4 

8 

0.39 

0.38 

1.34 

-0.07 

40325 

C 

0 

3 

6 

0.35 

0.16 

1.07 

-0.07 

40325 

D 

0 

6 

11 

-0.72 

0.13 

0.37 

-0.38 

40326 

* 

-1 

4598 

94 

0.97 

0.02 

0.00 

-0.08 

40326 

A 

1 

266 

93 

1.53 

0.07 

0.90 

0.33 

40326 

B 

0 

5 

2 

0.05 

0.57 

0.80 

-0.14 

40326 

C 

0 

7 

2 

0.14 

0.50 

1.04 

-0.16 

40326 

D 

0 

8 

3 

-0.45 

0.32 

0.40 

-0.25 

40327 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40327 

A 

1 

30 

56 

1.28 

0.22 

0.99 

0.50 

40327 

B 

0 

4 

7 

-0.71 

0.47 

0.36 

-0.34 

40327 

C 

0 

15 

28 

0.22 

0.22 

1.17 

-0.27 

40327 

D 

0 

5 

9 

0.25 

0.13 

0.74 

-0.13 

40328 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40328 

A 

1 

27 

50 

1.35 

0.20 

0.75 

0.55 

40328 

B 

0 

6 

11 

-0.17 

0.35 

0.57 

-0.26 

40328 

C 

0 

12 

22 

0.40 

0.19 

0.90 

-0.14 

40328 

D 

0 

9 

17 

-0.26 

0.45 

1.10 

-0.36 

40329 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.00 

40329 

A 

1 

43 

66 

1.46 

0.18 

1.00 

0.43 

40329 

B 

0 

14 

22 

0.80 

0.38 

2.09 

-0.08 

40329 

C 

0 

3 

5 

-0.92 

0.80 

0.27 

-0.30 

40329 

D 

0 

5 

8 

-1.00 

0.42 

0.23 

-0.41 

40330 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

-0.02 

40330 

A 

1 

13 

28 

2.03 

0.60 

2.34 

0.34 

40330 

B 

0 

10 

21 

1.20 

0.40 

1.82 

-0.02 

40330 

C 

0 

13 

28 

1.07 

0.27 

1.29 

-0.08 

40330 

D 

0 

11 

23 

0.61 

0.15 

0.56 

-0.25 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40331 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

40331 

A 

1 

22 

39 

1.70 

0.36 

1.27 

0.44 

40331 

B 

0 

10 

18 

-0.13 

0.27 

0.49 

-0.36 

40331 

C 

0 

18 

32 

0.71 

0.18 

1.02 

-0.12 

40331 

D 

0 

7 

12 

0.67 

0.22 

0.90 

-0.07 

40332 

* 

-1 

4818 

99 

1.00 

0.02 

0.00 

-0.01 

40332 

A 

1 

19 

29 

2.45 

0.26 

0.52 

0.62 

40332 

B 

0 

19 

29 

0.75 

0.22 

0.88 

-0.20 

40332 

C 

0 

9 

14 

0.77 

0.25 

0.70 

-0.12 

40332 

D 

0 

19 

29 

0.46 

0.28 

0.62 

-0.33 

40333 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.00 

40333 

A 

1 

50 

77 

1.28 

0.18 

0.90 

0.44 

40333 

B 

0 

6 

9 

-0.40 

0.26 

0.43 

-0.32 

40333 

C 

0 

7 

11 

-0.19 

0.35 

0.69 

-0.30 

40333 

D 

0 

2 

3 

0.96 

0.79 

1.95 

0.00 

40334 

* 

-1 

4598 

94 

0.99 

0.02 

0.00 

-0.04 

40334 

A 

1 

168 

59 

1.44 

0.07 

1.05 

0.31 

40334 

B 

0 

66 

23 

0.99 

0.12 

1.36 

-0.11 

40334 

C 

0 

39 

14 

0.68 

0.13 

0.90 

-0.21 

40334 

D 

0 

13 

5 

0.45 

0.21 

0.69 

-0.17 

40335 

* 

-1 

4826 

99 

0.99 

0.02 

0.00 

-0.02 

40335 

A 

1 

53 

91 

1.28 

0.17 

1.07 

0.08 

40335 

B 

0 

3 

5 

0.90 

1.11 

3.57 

-0.06 

40335 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40335 

D 

0 

2 

3 

0.89 

0.11 

1.17 

-0.05 

40336 

* 

-1 

4838 

99 

1.00 

0.02 

0.00 

0.01 

40336 

A 

1 

16 

35 

1.54 

0.26 

0.88 

0.50 

40336 

B 

0 

8 

17 

0.01 

0.39 

0.69 

-0.35 

40336 

C 

0 

13 

28 

0.63 

0.25 

1.03 

-0.11 

40336 

D 

0 

9 

20 

0.53 

0.17 

0.73 

-0.14 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40337 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.03 

40337 

A 

1 

28 

45 

1.37 

0.20 

0.91 

0.53 

40337 

B 

0 

16 

26 

-0.05 

0.22 

0.70 

-0.34 

40337 

C 

0 

13 

21 

0.33 

0.35 

1.19 

-0.14 

40337 

D 

0 

5 

8 

-0.24 

0.34 

0.47 

-0.22 

40338 

* 

-1 

4634 

95 

0.97 

0.02 

0.00 

-0.09 

40338 

A 

1 

119 

48 

2.01 

0.10 

1.02 

0.44 

40338 

B 

0 

51 

20 

0.96 

0.14 

0.90 

-0.27 

40338 

C 

0 

71 

28 

1.26 

0.08 

0.97 

-0.16 

40338 

D 

0 

9 

4 

0.40 

0.20 

0.39 

-0.21 

40339 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40339 

A 

1 

46 

82 

0.86 

0.13 

0.90 

0.44 

40339 

B 

0 

1 

2 

-0.58 

0.00 

0.39 

-0.17 

40339 

C 

0 

2 

4 

-0.57 

1.06 

0.63 

-0.24 

40339 

D 

0 

7 

13 

-0.17 

0.35 

0.90 

-0.31 

40340 

* 

-1 

4617 

95 

0.98 

0.02 

0.00 

-0.07 

40340 

A 

1 

215 

81 

1.60 

0.07 

0.91 

0.46 

40340 

B 

0 

12 

4 

0.25 

0.23 

0.58 

-0.23 

40340 

C 

0 

31 

12 

0.45 

0.14 

0.74 

-0.31 

40340 

D 

0 

9 

3 

0.24 

0.27 

0.57 

-0.20 

40341 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40341 

A 

1 

43 

83 

1.05 

0.17 

0.87 

0.44 

40341 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40341 

C 

0 

4 

8 

0.05 

0.22 

0.71 

-0.19 

40341 

D 

0 

5 

10 

-0.60 

0.22 

0.38 

-0.39 

40342 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40342 

A 

1 

34 

62 

1.08 

0.20 

0.85 

0.56 

40342 

B 

0 

3 

5 

0.89 

0.48 

2.22 

0.07 

40342 

C 

0 

6 

11 

-0.99 

0.30 

0.34 

-0.38 

40342 

D 

0 

12 

22 

-0.59 

0.34 

0.97 

-0.41 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40343 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.04 

40343 

A 

1 

33 

63 

0.93 

0.20 

1.06 

0.49 

40343 

B 

0 

4 

8 

-0.23 

0.07 

0.56 

-0.20 

40343 

C 

0 

5 

10 

0.26 

0.30 

1.10 

-0.08 

40343 

D 

0 

10 

19 

-0.40 

0.16 

0.52 

-0.41 

40344 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.02 

40344 

A 

1 

30 

50 

1.47 

0.16 

0.70 

0.61 

40344 

B 

0 

9 

15 

0.51 

0.36 

1.29 

-0.08 

40344 

C 

0 

7 

12 

-0.76 

0.23 

0.26 

-0.45 

40344 

D 

0 

14 

23 

0.05 

0.28 

0.84 

-0.31 

40345 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.03 

40345 

A 

1 

29 

60 

1.11 

0.19 

0.90 

0.53 

40345 

B 

0 

4 

8 

0.11 

0.71 

1.11 

-0.13 

40345 

C 

0 

9 

19 

-0.13 

0.21 

0.63 

-0.30 

40345 

D 

0 

6 

13 

-0.41 

0.46 

0.84 

-0.33 

40346 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

40346 

A 

1 

37 

64 

1.26 

0.16 

0.74 

0.56 

40346 

B 

0 

5 

9 

0.09 

0.37 

0.76 

-0.19 

40346 

C 

0 

9 

16 

0.02 

0.36 

0.84 

-0.30 

40346 

D 

0 

7 

12 

-0.20 

0.29 

0.57 

-0.33 

40347 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40347 

A 

1 

42 

76 

1.21 

0.15 

1.07 

0.43 

40347 

B 

0 

5 

9 

-0.03 

0.41 

0.62 

-0.29 

40347 

C 

0 

5 

9 

0.87 

0.37 

1.54 

-0.02 

40347 

D 

0 

3 

5 

-0.93 

0.50 

0.24 

-0.41 

40348 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.00 

40348 

A 

1 

26 

48 

1.73 

0.27 

0.82 

0.52 

40348 

B 

0 

8 

15 

0.01 

0.33 

0.58 

-0.30 

40348 

C 

0 

10 

19 

0.65 

0.32 

1.31 

-0.12 

40348 

D 

0 

10 

19 

0.19 

0.31 

0.77 

-0.28 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40349 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

-0.01 

40349 

A 

1 

45 

80 

1.49 

0.19 

0.75 

0.51 

40349 

B 

0 

1 

2 

-0.16 

0.00 

0.44 

-0.12 

40349 

C 

0 

5 

9 

-0.11 

0.47 

0.62 

-0.27 

40349 

D 

0 

5 

9 

-0.59 

0.65 

0.69 

-0.38 

40350 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40350 

A 

1 

28 

52 

0.89 

0.19 

1.11 

0.33 

40350 

B 

0 

7 

13 

-0.20 

0.45 

0.70 

-0.27 

40350 

C 

0 

12 

22 

0.39 

0.30 

1.44 

-0.08 

40350 

D 

0 

7 

13 

0.19 

0.33 

0.94 

-0.13 

40351 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40351 

A 

1 

51 

94 

0.81 

0.14 

1.03 

-0.07 

40351 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40351 

C 

0 

3 

6 

1.13 

0.96 

4.07 

0.07 

40351 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40352 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40352 

A 

1 

56 

97 

0.78 

0.17 

0.78 

0.42 

40352 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40352 

C 

0 

1 

2 

-3.26 

0.00 

0.05 

-0.38 

40352 

D 

0 

1 

2 

-1.41 

0.00 

0.30 

-0.20 

40353 

* 

-1 

4816 

99 

1.00 

0.02 

0.00 

0.00 

40353 

A 

1 

66 

97 

1.07 

0.19 

1.04 

0.10 

40353 

B 

0 

2 

3 

0.16 

0.59 

1.12 

-0.10 

40353 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40353 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40354 

* 

-1 

4814 

99 

1.00 

0.02 

0.00 

-0.01 

40354 

A 

-1 

70 

100 

1.14 

0.17 

0.00 

0.00 

40354 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40354 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40354 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40355 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40355 

A 

1 

37 

67 

0.75 

0.21 

1.11 

0.24 

40355 

B 

0 

8 

15 

-0.04 

0.52 

1.55 

-0.18 

40355 

C 

0 

5 

9 

0.76 

0.24 

1.83 

0.06 

40355 

D 

0 

5 

9 

-0.49 

0.78 

0.98 

-0.24 

40356 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

40356 

A 

1 

41 

80 

1.07 

0.23 

1.19 

0.10 

40356 

B 

0 

3 

6 

1.10 

0.36 

2.18 

0.02 

40356 

C 

0 

3 

6 

1.52 

1.16 

6.53 

0.09 

40356 

D 

0 

4 

8 

-0.22 

0.67 

0.95 

-0.24 

40357 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.03 

40357 

A 

1 

33 

66 

1.02 

0.18 

0.93 

0.48 

40357 

B 

0 

6 

12 

0.17 

0.46 

1.16 

-0.16 

40357 

C 

0 

5 

10 

-0.07 

0.27 

0.66 

-0.22 

40357 

D 

0 

6 

12 

-0.34 

0.34 

0.58 

-0.33 

40358 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.02 

40358 

A 

1 

46 

72 

1.03 

0.14 

0.96 

0.38 

40358 

B 

0 

5 

8 

0.43 

0.62 

1.37 

-0.08 

40358 

C 

0 

6 

9 

0.01 

0.30 

0.78 

-0.21 

40358 

D 

0 

7 

11 

-0.16 

0.62 

0.99 

-0.28 

40359 

* 

-1 

4814 

99 

0.99 

0.02 

0.00 

-0.02 

40359 

A 

1 

63 

90 

1.45 

0.16 

0.89 

0.45 

40359 

B 

0 

1 

1 

0.25 

0.00 

0.64 

-0.08 

40359 

C 

0 

3 

4 

-0.88 

1.15 

0.69 

-0.29 

40359 

D 

0 

3 

4 

-1.18 

1.95 

1.08 

-0.34 

40360 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40360 

A 

1 

41 

75 

0.87 

0.19 

1.25 

0.16 

40360 

B 

0 

5 

9 

0.58 

0.49 

1.58 

-0.05 

40360 

C 

0 

5 

9 

0.12 

0.32 

0.85 

-0.18 

40360 

D 

0 

4 

7 

0.76 

0.29 

1.44 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40361 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40361 

A 

1 

30 

55 

1.85 

0.32 

1.05 

0.52 

40361 

B 

0 

9 

16 

0.19 

0.36 

0.84 

-0.22 

40361 

C 

0 

3 

5 

0.12 

0.45 

0.66 

-0.13 

40361 

D 

0 

13 

24 

-0.06 

0.30 

0.64 

-0.36 

40362 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40362 

A 

1 

27 

49 

1.38 

0.24 

0.83 

0.49 

40362 

B 

0 

5 

9 

0.78 

0.38 

1.49 

0.03 

40362 

C 

0 

7 

13 

-0.18 

0.32 

0.61 

-0.21 

40362 

D 

0 

16 

29 

-0.30 

0.41 

0.78 

-0.40 

40363 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

-0.01 

40363 

A 

1 

19 

37 

1.91 

0.32 

0.79 

0.46 

40363 

B 

0 

13 

25 

0.67 

0.45 

1.57 

-0.18 

40363 

C 

0 

2 

4 

1.34 

0.28 

1.28 

0.04 

40363 

D 

0 

17 

33 

0.45 

0.20 

0.65 

-0.32 

40364 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40364 

A 

1 

19 

35 

2.14 

0.16 

0.43 

0.68 

40364 

B 

0 

16 

29 

0.09 

0.23 

0.57 

-0.29 

40364 

C 

0 

9 

16 

0.32 

0.19 

0.55 

-0.13 

40364 

D 

0 

11 

20 

-0.32 

0.60 

0.56 

-0.36 

40365 

* 

-1 

4812 

99 

1.00 

0.02 

0.00 

0.00 

40365 

A 

1 

52 

72 

1.50 

0.16 

0.74 

0.55 

40365 

B 

0 

2 

3 

-1.24 

0.44 

0.16 

-0.29 

40365 

C 

0 

7 

10 

-0.14 

0.13 

0.46 

-0.29 

40365 

D 

0 

11 

15 

0.07 

0.41 

1.39 

-0.31 

40366 

* 

-1 

4818 

99 

1.00 

0.02 

0.00 

-0.01 

40366 

A 

1 

44 

67 

1.78 

0.19 

0.85 

0.60 

40366 

B 

0 

2 

3 

-1.97 

1.39 

0.12 

-0.37 

40366 

C 

0 

7 

11 

0.16 

0.34 

0.66 

-0.23 

40366 

D 

0 

13 

20 

0.02 

0.25 

0.63 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40367 

* 

-1 

4624 

95 

0.97 

0.02 

0.00 

-0.09 

40367 

A 

1 

176 

68 

1.85 

0.08 

1.09 

0.44 

40367 

B 

0 

31 

12 

0.99 

0.14 

0.99 

-0.17 

40367 

C 

0 

37 

14 

0.78 

0.11 

0.74 

-0.27 

40367 

D 

0 

16 

6 

0.51 

0.18 

0.58 

-0.23 

40368 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.03 

40368 

A 

1 

12 

20 

1.60 

0.28 

0.86 

0.40 

40368 

B 

0 

10 

17 

0.54 

0.30 

0.87 

-0.05 

40368 

C 

0 

22 

37 

0.52 

0.24 

1.15 

-0.10 

40368 

D 

0 

16 

27 

0.25 

0.31 

0.77 

-0.22 

40369 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.00 

40369 

A 

1 

24 

42 

1.78 

0.26 

1.05 

0.49 

40369 

B 

0 

10 

18 

-0.09 

0.20 

0.38 

-0.42 

40369 

C 

0 

18 

32 

0.90 

0.22 

1.24 

-0.08 

40369 

D 

0 

5 

9 

0.36 

0.49 

0.72 

-0.17 

40370 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40370 

A 

1 

16 

28 

1.29 

0.25 

1.10 

0.35 

40370 

B 

0 

10 

18 

-0.18 

0.30 

0.50 

-0.39 

40370 

C 

0 

23 

40 

0.77 

0.17 

1.20 

0.05 

40370 

D 

0 

8 

14 

0.47 

0.39 

1.00 

-0.09 

40371 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40371 

A 

1 

14 

25 

1.82 

0.40 

1.01 

0.48 

40371 

B 

0 

7 

13 

0.56 

0.16 

0.71 

-0.10 

40371 

C 

0 

15 

27 

0.97 

0.19 

1.26 

0.05 

40371 

D 

0 

19 

35 

0.19 

0.19 

0.61 

-0.42 

40372 

* 

-1 

4836 

99 

0.99 

0.02 

0.00 

-0.03 

40372 

A 

1 

45 

94 

1.45 

0.18 

0.94 

0.34 

40372 

B 

0 

2 

4 

-0.21 

0.43 

0.40 

-0.26 

40372 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40372 

D 

0 

1 

2 

-0.45 

0.00 

0.29 

-0.21 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40373 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40373 

A 

1 

53 

96 

0.68 

0.14 

1.00 

0.24 

40373 

B 

0 

2 

4 

-0.64 

0.32 

0.48 

-0.24 

40373 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40373 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40374 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40374 

A 

1 

45 

83 

1.01 

0.15 

0.81 

0.44 

40374 

B 

0 

1 

2 

-0.97 

0.00 

0.27 

-0.17 

40374 

C 

0 

7 

13 

0.07 

0.58 

2.05 

-0.19 

40374 

D 

0 

1 

2 

-4.95 

0.00 

0.01 

-0.58 

40375 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.03 

40375 

A 

1 

36 

68 

1.02 

0.18 

0.97 

0.45 

40375 

B 

0 

4 

8 

-0.38 

0.28 

0.47 

-0.25 

40375 

C 

0 

12 

23 

0.24 

0.22 

0.99 

-0.19 

40375 

D 

0 

1 

2 

-3.36 

0.00 

0.02 

-0.47 

40376 

* 

-1 

4627 

95 

0.98 

0.02 

0.00 

-0.07 

40376 

A 

1 

208 

81 

1.58 

0.07 

0.94 

0.39 

40376 

B 

0 

19 

7 

0.44 

0.24 

0.95 

-0.24 

40376 

C 

0 

22 

9 

0.77 

0.19 

1.04 

-0.17 

40376 

D 

0 

8 

3 

-0.01 

0.18 

0.38 

-0.23 

40377 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.02 

40377 

A 

1 

24 

48 

1.47 

0.30 

1.16 

0.49 

40377 

B 

0 

2 

4 

0.16 

0.54 

0.67 

-0.08 

40377 

C 

0 

12 

24 

0.36 

0.22 

0.96 

-0.15 

40377 

D 

0 

12 

24 

-0.26 

0.41 

0.71 

-0.39 

40378 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.03 

40378 

A 

1 

46 

71 

1.16 

0.21 

1.15 

0.42 

40378 

B 

0 

7 

11 

0.43 

0.26 

1.09 

-0.06 

40378 

C 

0 

2 

3 

-0.76 

0.72 

0.35 

-0.15 

40378 

D 

0 

10 

15 

-0.92 

0.77 

0.93 

-0.41 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40379 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

-0.02 

40379 

A 

1 

29 

60 

1.52 

0.21 

0.94 

0.37 

40379 

B 

0 

7 

15 

0.62 

0.37 

0.95 

-0.22 

40379 

C 

0 

6 

13 

0.86 

0.40 

1.18 

-0.12 

40379 

D 

0 

6 

13 

0.64 

0.30 

0.81 

-0.20 

40380 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40380 

A 

1 

28 

54 

1.21 

0.22 

1.26 

0.40 

40380 

B 

0 

7 

13 

0.47 

0.17 

0.82 

-0.12 

40380 

C 

0 

10 

19 

0.33 

0.19 

0.76 

-0.22 

40380 

D 

0 

7 

13 

0.23 

0.48 

0.92 

-0.22 

40381 

* 

-1 

4816 

99 

1.00 

0.02 

0.00 

-0.02 

40381 

A 

1 

55 

81 

1.46 

0.18 

1.14 

0.37 

40381 

B 

0 

2 

3 

1.35 

2.45 

11.34 

0.02 

40381 

C 

0 

5 

7 

0.02 

0.43 

0.68 

-0.23 

40381 

D 

0 

6 

9 

-0.20 

0.33 

0.54 

-0.30 

40382 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40382 

A 

1 

28 

51 

1.55 

0.30 

0.86 

0.54 

40382 

B 

0 

10 

18 

0.36 

0.30 

1.22 

-0.10 

40382 

C 

0 

12 

22 

-0.38 

0.34 

0.63 

-0.35 

40382 

D 

0 

5 

9 

-0.83 

0.63 

0.50 

-0.30 

40383 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40383 

A 

1 

11 

20 

1.79 

0.41 

0.89 

0.44 

40383 

B 

0 

14 

25 

0.74 

0.33 

1.56 

0.03 

40383 

C 

0 

17 

31 

0.13 

0.25 

0.75 

-0.28 

40383 

D 

0 

13 

24 

0.36 

0.30 

0.94 

-0.14 

40384 

* 

-1 

4812 

99 

1.00 

0.02 

0.00 

-0.02 

40384 

A 

1 

49 

68 

1.72 

0.18 

0.94 

0.54 

40384 

B 

0 

12 

17 

-0.11 

0.47 

1.49 

-0.38 

40384 

C 

0 

2 

3 

-0.27 

1.15 

0.56 

-0.16 

40384 

D 

0 

9 

13 

0.20 

0.23 

0.63 

-0.25 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40385 

* 

-1 

4813 

99 

1.00 

0.02 

0.00 

0.00 

40385 

A 

1 

36 

51 

1.55 

0.28 

1.64 

0.39 

40385 

B 

0 

21 

30 

0.77 

0.23 

1.99 

-0.08 

40385 

C 

0 

5 

7 

-0.30 

0.51 

0.50 

-0.23 

40385 

D 

0 

9 

13 

-0.23 

0.24 

0.43 

-0.30 

40386 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.00 

40386 

A 

1 

5 

9 

1.42 

0.42 

1.24 

0.17 

40386 

B 

0 

34 

64 

0.86 

0.17 

1.52 

-0.12 

40386 

C 

0 

6 

11 

0.81 

0.12 

0.65 

-0.05 

40386 

D 

0 

8 

15 

1.11 

0.32 

1.19 

0.07 

40387 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.00 

40387 

A 

1 

18 

32 

1.95 

0.30 

0.79 

0.49 

40387 

B 

0 

16 

29 

0.44 

0.20 

0.60 

-0.26 

40387 

C 

0 

3 

5 

1.08 

0.65 

1.24 

0.01 

40387 

D 

0 

19 

34 

0.55 

0.32 

0.86 

-0.24 

40388 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.00 

40388 

A 

1 

22 

45 

1.62 

0.23 

0.97 

0.45 

40388 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40388 

C 

0 

26 

53 

0.71 

0.15 

0.93 

-0.31 

40388 

D 

0 

1 

2 

-3.03 

0.00 

0.02 

-0.51 

40389 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

-0.02 

40389 

A 

1 

19 

35 

1.97 

0.27 

0.92 

0.47 

40389 

B 

0 

7 

13 

0.86 

0.42 

1.05 

-0.11 

40389 

C 

0 

21 

38 

0.81 

0.24 

0.98 

-0.27 

40389 

D 

0 

8 

15 

0.75 

0.28 

0.73 

-0.16 

40390 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.00 

40390 

A 

1 

43 

69 

1.52 

0.17 

0.79 

0.56 

40390 

B 

0 

6 

10 

-0.27 

0.35 

0.45 

-0.28 

40390 

C 

0 

6 

10 

0.20 

0.45 

0.81 

-0.17 

40390 

D 

0 

7 

11 

-0.64 

0.77 

0.57 

-0.40 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40391 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40391 

A 

1 

49 

89 

1.04 

0.19 

0.85 

0.37 

40391 

B 

0 

1 

2 

0.04 

0.00 

0.86 

-0.08 

40391 

C 

0 

5 

9 

-0.83 

0.80 

0.86 

-0.36 

40391 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40392 

* 

-1 

4839 

99 

1.00 

0.02 

0.00 

-0.01 

40392 

A 

1 

44 

98 

1.13 

0.16 

0.93 

0.31 

40392 

B 

0 

1 

2 

-1.22 

0.00 

0.17 

-0.31 

40392 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40392 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40393 

* 

-1 

4821 

99 

0.99 

0.02 

0.00 

-0.03 

40393 

A 

1 

58 

92 

1.41 

0.17 

1.14 

0.16 

40393 

B 

0 

2 

3 

1.49 

0.59 

2.53 

0.02 

40393 

C 

0 

2 

3 

0.19 

0.28 

0.61 

-0.16 

40393 

D 

0 

1 

2 

-0.11 

0.00 

0.43 

-0.14 

40394 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40394 

A 

1 

51 

91 

1.01 

0.18 

0.96 

0.35 

40394 

B 

0 

2 

4 

-0.07 

0.81 

0.96 

-0.14 

40394 

C 

0 

3 

5 

-0.94 

0.38 

0.34 

-0.33 

40394 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40395 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40395 

A 

1 

53 

96 

0.88 

0.17 

0.91 

0.33 

40395 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40395 

C 

0 

2 

4 

-1.32 

0.43 

0.24 

-0.33 

40395 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40396 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40396 

A 

1 

52 

95 

0.86 

0.16 

1.01 

0.18 

40396 

B 

0 

2 

4 

-0.52 

0.25 

0.43 

-0.23 

40396 

C 

0 

1 

2 

0.93 

0.00 

1.79 

0.01 

40396 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40397 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40397 

A 

1 

51 

91 

0.78 

0.17 

1.10 

0.30 

40397 

B 

0 

3 

5 

-0.76 

0.53 

0.57 

-0.27 

40397 

C 

0 

1 

2 

0.15 

0.00 

1.05 

-0.06 

40397 

D 

0 

1 

2 

-0.45 

0.00 

0.58 

-0.12 

40398 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40398 

A 

1 

49 

88 

0.96 

0.16 

0.75 

0.53 

40398 

B 

0 

4 

7 

-0.66 

0.31 

0.48 

-0.30 

40398 

C 

0 

1 

2 

-0.56 

0.00 

0.45 

-0.14 

40398 

D 

0 

2 

4 

-2.09 

0.94 

0.15 

-0.43 

40399 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40399 

A 

1 

49 

89 

0.91 

0.15 

0.73 

0.59 

40399 

B 

0 

2 

4 

-1.38 

0.02 

0.22 

-0.32 

40399 

C 

0 

3 

5 

-1.23 

0.46 

0.31 

-0.37 

40399 

D 

0 

1 

2 

-2.05 

0.00 

0.11 

-0.30 

40400 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40400 

A 

1 

51 

93 

0.99 

0.14 

0.89 

0.38 

40400 

B 

0 

2 

4 

-1.13 

0.62 

0.24 

-0.37 

40400 

C 

0 

2 

4 

0.05 

0.17 

0.66 

-0.15 

40400 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40401 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40401 

A 

1 

29 

53 

1.20 

0.21 

1.01 

0.55 

40401 

B 

0 

13 

24 

0.00 

0.19 

0.74 

-0.25 

40401 

C 

0 

4 

7 

-0.23 

0.30 

0.55 

-0.17 

40401 

D 

0 

9 

16 

-0.41 

0.46 

0.81 

-0.34 

40402 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40402 

A 

1 

32 

58 

1.30 

0.24 

1.15 

0.39 

40402 

B 

0 

9 

16 

0.31 

0.23 

0.84 

-0.17 

40402 

C 

0 

6 

11 

0.29 

0.50 

1.23 

-0.15 

40402 

D 

0 

8 

15 

0.08 

0.56 

1.11 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40403 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40403 

A 

1 

26 

47 

1.44 

0.31 

1.24 

0.47 

40403 

B 

0 

6 

11 

-0.23 

0.54 

0.78 

-0.23 

40403 

C 

0 

12 

22 

0.45 

0.21 

1.15 

-0.10 

40403 

D 

0 

11 

20 

-0.20 

0.29 

0.72 

-0.31 

40404 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40404 

A 

1 

29 

53 

1.30 

0.26 

1.04 

0.37 

40404 

B 

0 

8 

15 

0.43 

0.26 

0.97 

-0.12 

40404 

C 

0 

9 

16 

0.45 

0.40 

1.61 

-0.12 

40404 

D 

0 

9 

16 

0.01 

0.43 

1.19 

-0.27 

40405 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.04 

40405 

A 

1 

20 

33 

0.76 

0.24 

1.29 

0.22 

40405 

B 

0 

15 

25 

0.28 

0.21 

1.01 

-0.14 

40405 

C 

0 

16 

26 

0.45 

0.21 

1.14 

-0.02 

40405 

D 

0 

10 

16 

0.30 

0.18 

0.88 

-0.09 

40406 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40406 

A 

1 

17 

31 

1.75 

0.32 

0.79 

0.53 

40406 

B 

0 

11 

20 

0.35 

0.23 

0.88 

-0.06 

40406 

C 

0 

14 

25 

-0.04 

0.45 

0.78 

-0.22 

40406 

D 

0 

13 

24 

-0.27 

0.37 

0.59 

-0.29 

40407 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.00 

40407 

A 

1 

29 

55 

1.49 

0.29 

1.30 

0.40 

40407 

B 

0 

10 

19 

0.18 

0.46 

1.12 

-0.26 

40407 

C 

0 

7 

13 

0.58 

0.22 

0.96 

-0.11 

40407 

D 

0 

7 

13 

0.29 

0.32 

0.81 

-0.18 

40408 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.03 

40408 

A 

1 

23 

39 

1.14 

0.25 

1.22 

0.37 

40408 

B 

0 

19 

32 

0.40 

0.23 

1.05 

-0.14 

40408 

C 

0 

8 

14 

0.38 

0.21 

0.81 

-0.09 

40408 

D 

0 

9 

15 

0.01 

0.36 

0.79 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40409 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.01 

40409 

A 

1 

21 

33 

1.81 

0.32 

1.14 

0.47 

40409 

B 

0 

11 

17 

0.63 

0.31 

0.97 

-0.07 

40409 

C 

0 

11 

17 

0.76 

0.22 

0.98 

-0.03 

40409 

D 

0 

21 

33 

0.07 

0.30 

0.61 

-0.38 

40410 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40410 

A 

1 

54 

98 

0.84 

0.17 

1.01 

0.14 

40410 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40410 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40410 

D 

0 

1 

2 

-0.43 

0.00 

0.53 

-0.14 

40411 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.05 

40411 

A 

1 

50 

91 

0.66 

0.13 

0.64 

0.64 

40411 

B 

0 

2 

4 

-1.59 

0.89 

0.35 

-0.30 

40411 

C 

0 

1 

2 

-1.87 

0.00 

0.18 

-0.24 

40411 

D 

0 

2 

4 

-3.12 

1.83 

0.17 

-0.52 

40412 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40412 

A 

1 

52 

93 

0.81 

0.20 

1.11 

0.26 

40412 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40412 

C 

0 

3 

5 

-0.80 

1.15 

1.59 

-0.24 

40412 

D 

0 

1 

2 

-0.38 

0.00 

0.79 

-0.10 

40413 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40413 

A 

1 

51 

94 

1.08 

0.23 

0.77 

0.53 

40413 

B 

0 

1 

2 

-1.23 

0.00 

0.35 

-0.15 

40413 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40413 

D 

0 

2 

4 

-4.47 

1.07 

0.04 

-0.54 

40414 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40414 

A 

1 

53 

96 

1.08 

0.15 

0.96 

0.28 

40414 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40414 

C 

0 

2 

4 

-0.59 

0.07 

0.33 

-0.28 

40414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40415 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.04 

40415 

A 

1 

48 

91 

0.55 

0.17 

1.13 

0.24 

40415 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40415 

C 

0 

2 

4 

0.85 

0.64 

2.60 

0.06 

40415 

D 

0 

3 

6 

-1.57 

1.99 

2.12 

-0.36 

40416 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40416 

A 

-1 

55 

100 

0.81 

0.18 

0.00 

0.00 

40416 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40416 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40416 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40417 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.00 

40417 

A 

1 

46 

96 

1.05 

0.18 

1.03 

0.29 

40417 

B 

0 

1 

2 

-1.02 

0.00 

0.26 

-0.24 

40417 

C 

0 

1 

2 

-0.41 

0.00 

0.48 

-0.16 

40417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40418 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.00 

40418 

A 

1 

54 

96 

1.07 

0.17 

0.81 

0.40 

40418 

B 

0 

1 

2 

-1.07 

0.00 

0.28 

-0.20 

40418 

C 

0 

1 

2 

-2.52 

0.00 

0.06 

-0.35 

40418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40419 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.01 

40419 

A 

1 

53 

87 

1.03 

0.14 

1.05 

0.28 

40419 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40419 

C 

0 

2 

3 

0.03 

0.28 

0.61 

-0.16 

40419 

D 

0 

6 

10 

0.24 

0.45 

1.05 

-0.22 

40420 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40420 

A 

1 

46 

85 

0.78 

0.14 

0.88 

0.55 

40420 

B 

0 

2 

4 

-0.02 

1.09 

1.27 

-0.07 

40420 

C 

0 

1 

2 

-0.89 

0.00 

0.32 

-0.14 

40420 

D 

0 

5 

9 

-1.89 

1.00 

0.34 

-0.56 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40421 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.01 

40421 

A 

1 

63 

97 

0.94 

0.17 

1.07 

0.01 

40421 

B 

0 

1 

2 

1.84 

0.00 

5.33 

0.08 

40421 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40421 

D 

0 

1 

2 

-0.08 

0.00 

0.79 

-0.09 

40422 

* 

-1 

4837 

99 

0.99 

0.02 

0.00 

-0.02 

40422 

A 

1 

40 

85 

1.38 

0.20 

1.72 

0.10 

40422 

B 

0 

4 

9 

1.69 

0.55 

3.31 

0.09 

40422 

C 

0 

1 

2 

1.44 

0.00 

1.82 

0.01 

40422 

D 

0 

2 

4 

-0.57 

0.45 

0.27 

-0.32 

40423 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40423 

A 

1 

43 

78 

0.83 

0.21 

1.42 

0.28 

40423 

B 

0 

2 

4 

-0.04 

0.79 

0.98 

-0.07 

40423 

C 

0 

8 

15 

0.33 

0.56 

2.84 

-0.07 

40423 

D 

0 

2 

4 

-2.99 

2.49 

0.47 

-0.43 

40424 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40424 

A 

1 

47 

87 

0.92 

0.16 

1.15 

0.10 

40424 

B 

0 

2 

4 

0.43 

0.86 

1.28 

-0.08 

40424 

C 

0 

2 

4 

0.97 

1.20 

2.86 

0.02 

40424 

D 

0 

3 

6 

0.43 

0.33 

1.02 

-0.10 

40425 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40425 

A 

1 

42 

74 

1.09 

0.21 

0.82 

0.44 

40425 

B 

0 

3 

5 

-0.38 

1.41 

2.91 

-0.17 

40425 

C 

0 

3 

5 

-0.12 

1.07 

1.58 

-0.13 

40425 

D 

0 

9 

16 

-0.50 

0.36 

0.66 

-0.35 

40426 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40426 

A 

1 

47 

85 

0.78 

0.17 

1.04 

0.27 

40426 

B 

0 

2 

4 

0.60 

0.20 

1.48 

-0.01 

40426 

C 

0 

3 

5 

-0.81 

0.71 

0.59 

-0.29 

40426 

D 

0 

3 

5 

0.05 

0.47 

1.04 

-0.12 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40427 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40427 

A 

1 

32 

57 

0.83 

0.16 

0.96 

0.36 

40427 

B 

0 

11 

20 

0.15 

0.27 

1.02 

-0.16 

40427 

C 

0 

5 

9 

-0.19 

0.62 

0.93 

-0.21 

40427 

D 

0 

8 

14 

0.10 

0.41 

1.15 

-0.16 

40428 

* 

-1 

4825 

99 

1.01 

0.02 

0.00 

0.06 

40428 

A 

1 

34 

58 

0.74 

0.29 

1.27 

0.30 

40428 

B 

0 

7 

12 

-0.47 

0.53 

1.17 

-0.17 

40428 

C 

0 

3 

5 

0.16 

0.33 

1.15 

-0.02 

40428 

D 

0 

15 

25 

-0.24 

0.44 

1.47 

-0.20 

40429 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

-0.01 

40429 

A 

1 

24 

44 

1.54 

0.24 

1.10 

0.34 

40429 

B 

0 

12 

22 

0.74 

0.26 

0.99 

-0.18 

40429 

C 

0 

5 

9 

0.24 

0.55 

0.86 

-0.25 

40429 

D 

0 

13 

24 

1.02 

0.26 

1.40 

-0.05 

40430 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.01 

40430 

A 

1 

35 

56 

1.30 

0.22 

0.98 

0.34 

40430 

B 

0 

8 

13 

0.87 

0.47 

2.35 

0.00 

40430 

C 

0 

4 

6 

0.53 

0.14 

0.84 

-0.06 

40430 

D 

0 

16 

25 

0.00 

0.38 

0.99 

-0.36 

40431 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40431 

A 

1 

29 

51 

1.19 

0.22 

0.99 

0.39 

40431 

B 

0 

6 

11 

-0.19 

0.29 

0.53 

-0.24 

40431 

C 

0 

3 

5 

1.96 

0.78 

6.44 

0.23 

40431 

D 

0 

19 

33 

0.04 

0.24 

0.95 

-0.37 

40432 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

-0.01 

40432 

A 

1 

26 

54 

1.33 

0.25 

1.27 

0.23 

40432 

B 

0 

7 

15 

1.07 

0.31 

1.42 

-0.02 

40432 

C 

0 

3 

6 

0.51 

0.47 

0.79 

-0.15 

40432 

D 

0 

12 

25 

0.81 

0.17 

0.98 

-0.17 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40433 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

40433 

A 

1 

35 

61 

0.84 

0.20 

1.67 

0.30 

40433 

B 

0 

7 

12 

0.14 

0.72 

1.74 

-0.09 

40433 

C 

0 

5 

9 

0.51 

0.27 

1.13 

0.00 

40433 

D 

0 

10 

18 

-0.47 

0.62 

0.80 

-0.31 

40434 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40434 

A 

1 

26 

47 

1.30 

0.20 

0.82 

0.51 

40434 

B 

0 

10 

18 

-0.26 

0.13 

0.42 

-0.38 

40434 

C 

0 

9 

16 

0.60 

0.25 

1.15 

-0.03 

40434 

D 

0 

10 

18 

0.02 

0.48 

1.19 

-0.26 

40435 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.01 

40435 

A 

1 

39 

61 

1.25 

0.19 

1.00 

0.44 

40435 

B 

0 

10 

16 

0.20 

0.36 

1.25 

-0.23 

40435 

C 

0 

2 

3 

-0.64 

0.56 

0.32 

-0.22 

40435 

D 

0 

13 

20 

0.29 

0.22 

0.95 

-0.23 

40436 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40436 

A 

1 

12 

22 

1.19 

0.40 

1.18 

0.32 

40436 

B 

0 

38 

70 

0.43 

0.15 

1.04 

-0.17 

40436 

C 

0 

2 

4 

0.07 

0.29 

0.51 

-0.09 

40436 

D 

0 

2 

4 

-0.52 

0.52 

0.31 

-0.20 

40437 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.03 

40437 

A 

1 

33 

56 

1.16 

0.22 

1.04 

0.46 

40437 

B 

0 

11 

19 

0.12 

0.21 

0.83 

-0.20 

40437 

C 

0 

1 

2 

-0.08 

0.00 

0.57 

-0.08 

40437 

D 

0 

14 

24 

-0.09 

0.29 

1.11 

-0.33 

40438 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.00 

40438 

A 

1 

23 

47 

1.34 

0.27 

1.77 

0.24 

40438 

B 

0 

25 

51 

0.86 

0.18 

1.12 

-0.17 

40438 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40438 

D 

0 

1 

2 

-1.00 

0.00 

0.13 

-0.26 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40439 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

-0.01 

40439 

A 

1 

28 

58 

1.47 

0.31 

1.29 

0.25 

40439 

B 

0 

9 

19 

0.48 

0.44 

1.52 

-0.23 

40439 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40439 

D 

0 

11 

23 

0.93 

0.24 

1.29 

-0.09 

40440 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40440 

A 

1 

14 

25 

1.19 

0.34 

1.59 

0.20 

40440 

B 

0 

36 

65 

0.71 

0.18 

1.30 

-0.10 

40440 

C 

0 

2 

4 

1.07 

0.23 

1.10 

0.05 

40440 

D 

0 

3 

5 

-0.20 

0.75 

0.53 

-0.21 

40441 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.02 

40441 

A 

1 

35 

70 

1.18 

0.28 

1.19 

0.45 

40441 

B 

0 

7 

14 

-0.32 

0.29 

0.69 

-0.26 

40441 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40441 

D 

0 

8 

16 

-0.44 

0.27 

0.65 

-0.31 

40442 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

0.05 

40442 

A 

1 

16 

34 

0.97 

0.37 

2.15 

0.25 

40442 

B 

0 

27 

57 

0.59 

0.20 

1.45 

0.14 

40442 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40442 

D 

0 

4 

9 

-3.51 

1.16 

0.11 

-0.67 

40443 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40443 

A 

1 

51 

91 

1.07 

0.18 

0.86 

0.38 

40443 

B 

0 

3 

5 

-0.39 

0.31 

0.52 

-0.23 

40443 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40443 

D 

0 

2 

4 

-1.28 

0.50 

0.22 

-0.31 

40444 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.01 

40444 

A 

1 

41 

84 

1.15 

0.20 

1.00 

0.39 

40444 

B 

0 

5 

10 

-0.03 

0.44 

0.93 

-0.25 

40444 

C 

0 

2 

4 

-0.55 

0.77 

0.48 

-0.24 

40444 

D 

0 

1 

2 

-0.36 

0.00 

0.44 

-0.14 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40445 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

40445 

A 

1 

50 

88 

0.82 

0.17 

0.74 

0.57 

40445 

B 

0 

1 

2 

-0.10 

0.00 

1.09 

-0.06 

40445 

C 

0 

3 

5 

-1.87 

0.30 

0.20 

-0.39 

40445 

D 

0 

3 

5 

-2.07 

0.66 

0.21 

-0.42 

40446 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.01 

40446 

A 

1 

46 

96 

1.00 

0.21 

1.02 

0.44 

40446 

B 

0 

1 

2 

0.15 

0.00 

0.84 

-0.06 

40446 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40446 

D 

0 

1 

2 

-5.49 

0.00 

0.00 

-0.56 

40447 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40447 

A 

1 

51 

93 

0.64 

0.17 

1.10 

0.26 

40447 

B 

0 

2 

4 

0.38 

0.47 

1.72 

-0.03 

40447 

C 

0 

1 

2 

-1.13 

0.00 

0.34 

-0.19 

40447 

D 

0 

1 

2 

-1.96 

0.00 

0.15 

-0.28 

40448 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40448 

A 

1 

51 

93 

0.68 

0.15 

1.09 

0.06 

40448 

B 

0 

1 

2 

-0.81 

0.00 

0.36 

-0.19 

40448 

C 

0 

3 

5 

0.87 

0.09 

1.92 

0.05 

40448 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40449 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40449 

A 

1 

44 

80 

0.98 

0.18 

0.82 

0.54 

40449 

B 

0 

7 

13 

-0.95 

0.31 

0.41 

-0.48 

40449 

C 

0 

2 

4 

-0.30 

0.39 

0.66 

-0.14 

40449 

D 

0 

2 

4 

-0.39 

0.05 

0.56 

-0.16 

40450 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40450 

A 

1 

53 

93 

0.90 

0.14 

1.00 

0.45 

40450 

B 

0 

1 

2 

0.46 

0.00 

0.98 

-0.03 

40450 

C 

0 

2 

4 

-0.22 

0.21 

0.51 

-0.14 

40450 

D 

0 

1 

2 

-5.50 

0.00 

0.00 

-0.64 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40451 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40451 

A 

1 

45 

80 

0.87 

0.16 

1.04 

0.36 

40451 

B 

0 

3 

5 

0.34 

0.60 

1.50 

-0.07 

40451 

C 

0 

5 

9 

-0.38 

0.62 

0.84 

-0.28 

40451 

D 

0 

3 

5 

-0.34 

0.57 

0.69 

-0.21 

40452 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40452 

A 

1 

44 

79 

1.25 

0.22 

0.95 

0.40 

40452 

B 

0 

4 

7 

0.29 

0.65 

1.71 

-0.11 

40452 

C 

0 

7 

13 

-0.49 

0.52 

1.03 

-0.34 

40452 

D 

0 

1 

2 

-1.14 

0.00 

0.23 

-0.18 

40453 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40453 

A 

1 

50 

88 

0.95 

0.15 

0.73 

0.64 

40453 

B 

0 

3 

5 

-1.77 

0.41 

0.16 

-0.39 

40453 

C 

0 

1 

2 

-0.39 

0.00 

0.55 

-0.09 

40453 

D 

0 

3 

5 

-2.45 

1.47 

0.33 

-0.50 

40454 

* 

-1 

4640 

95 

0.99 

0.02 

0.00 

-0.03 

40454 

A 

1 

207 

85 

1.33 

0.07 

1.00 

0.34 

40454 

B 

0 

30 

12 

0.50 

0.09 

0.76 

-0.26 

40454 

C 

0 

6 

2 

0.02 

0.19 

0.46 

-0.19 

40454 

D 

0 

1 

0 

-0.78 

0.00 

0.19 

-0.13 

40455 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40455 

A 

1 

49 

88 

0.80 

0.20 

1.16 

0.27 

40455 

B 

0 

5 

9 

-0.25 

0.22 

0.83 

-0.21 

40455 

C 

0 

1 

2 

0.12 

0.00 

1.08 

-0.05 

40455 

D 

0 

1 

2 

-1.17 

0.00 

0.30 

-0.18 

40456 

* 

-1 

4825 

99 

1.01 

0.02 

0.00 

0.06 

40456 

A 

1 

51 

86 

0.48 

0.17 

1.00 

0.41 

40456 

B 

0 

1 

2 

-1.04 

0.00 

0.41 

-0.12 

40456 

C 

0 

3 

5 

-0.27 

0.62 

1.21 

-0.08 

40456 

D 

0 

4 

7 

-1.95 

1.23 

0.83 

-0.42 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


303 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40457 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.03 

40457 

A 

1 

50 

83 

0.93 

0.16 

0.89 

0.45 

40457 

B 

0 

7 

12 

-0.25 

0.30 

0.78 

-0.27 

40457 

C 

0 

1 

2 

-3.26 

0.00 

0.03 

-0.41 

40457 

D 

0 

2 

3 

-0.53 

0.91 

0.66 

-0.18 

40458 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40458 

A 

1 

40 

73 

0.98 

0.19 

0.90 

0.52 

40458 

B 

0 

6 

11 

-0.31 

0.45 

0.79 

-0.19 

40458 

C 

0 

3 

5 

-0.11 

0.29 

0.71 

-0.10 

40458 

D 

0 

6 

11 

-1.53 

0.87 

0.40 

-0.48 

40459 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.01 

40459 

A 

1 

32 

67 

1.38 

0.26 

1.10 

0.51 

40459 

B 

0 

4 

8 

0.03 

0.28 

0.71 

-0.16 

40459 

C 

0 

5 

10 

-0.98 

0.59 

0.40 

-0.41 

40459 

D 

0 

7 

15 

0.07 

0.33 

0.87 

-0.20 

40460 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40460 

A 

1 

39 

71 

1.13 

0.19 

0.84 

0.55 

40460 

B 

0 

4 

7 

-0.15 

0.35 

0.74 

-0.16 

40460 

C 

0 

5 

9 

0.19 

0.44 

1.25 

-0.11 

40460 

D 

0 

7 

13 

-1.25 

0.38 

0.29 

-0.53 

40461 

* 

-1 

4826 

99 

1.01 

0.02 

0.00 

0.05 

40461 

A 

1 

41 

71 

0.75 

0.15 

0.94 

0.44 

40461 

B 

0 

9 

16 

-0.05 

0.23 

0.89 

-0.16 

40461 

C 

0 

6 

10 

-0.19 

0.38 

0.95 

-0.17 

40461 

D 

0 

2 

3 

-2.75 

2.60 

0.65 

-0.49 

40462 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40462 

A 

1 

34 

62 

1.02 

0.22 

1.14 

0.27 

40462 

B 

0 

10 

18 

0.78 

0.37 

2.34 

0.01 

40462 

C 

0 

4 

7 

0.26 

0.60 

1.32 

-0.11 

40462 

D 

0 

7 

13 

-0.26 

0.23 

0.52 

-0.32 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40463 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40463 

A 

1 

43 

78 

1.22 

0.20 

0.89 

0.41 

40463 

B 

0 

6 

11 

-0.26 

0.30 

0.55 

-0.31 

40463 

C 

0 

2 

4 

0.16 

0.08 

0.69 

-0.11 

40463 

D 

0 

4 

7 

-0.04 

0.59 

0.82 

-0.20 

40464 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40464 

A 

1 

50 

91 

0.97 

0.14 

0.89 

0.40 

40464 

B 

0 

1 

2 

-1.53 

0.00 

0.14 

-0.30 

40464 

C 

0 

1 

2 

0.51 

0.00 

1.10 

-0.04 

40464 

D 

0 

3 

5 

-0.51 

0.34 

0.44 

-0.30 

40465 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.00 

40465 

A 

1 

44 

90 

1.18 

0.23 

0.95 

0.34 

40465 

B 

0 

2 

4 

0.01 

0.49 

0.84 

-0.13 

40465 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40465 

D 

0 

3 

6 

-0.88 

0.37 

0.35 

-0.31 

40466 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.00 

40466 

A 

1 

44 

85 

1.19 

0.16 

0.85 

0.44 

40466 

B 

0 

3 

6 

0.18 

0.74 

1.02 

-0.17 

40466 

C 

0 

2 

4 

-0.25 

1.06 

0.73 

-0.21 

40466 

D 

0 

3 

6 

-0.61 

0.25 

0.34 

-0.34 

40467 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.01 

40467 

A 

1 

57 

97 

1.00 

0.13 

0.80 

0.46 

40467 

B 

0 

1 

2 

-0.99 

0.00 

0.27 

-0.23 

40467 

C 

0 

1 

2 

-2.50 

0.00 

0.06 

-0.41 

40467 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40468 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

40468 

A 

1 

46 

94 

0.96 

0.17 

0.64 

0.58 

40468 

B 

0 

1 

2 

-2.55 

0.00 

0.08 

-0.35 

40468 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40468 

D 

0 

2 

4 

-2.20 

0.33 

0.12 

-0.45 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


305 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40469 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40469 

A 

1 

48 

89 

0.74 

0.15 

0.87 

0.41 

40469 

B 

0 

3 

6 

0.10 

0.23 

1.03 

-0.10 

40469 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40469 

D 

0 

3 

6 

-1.59 

0.48 

0.22 

-0.46 

40470 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40470 

A 

1 

50 

91 

0.84 

0.21 

1.14 

0.15 

40470 

B 

0 

4 

7 

0.29 

0.43 

1.57 

-0.09 

40470 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40470 

D 

0 

1 

2 

-0.63 

0.00 

0.48 

-0.13 

40471 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40471 

A 

1 

52 

91 

0.87 

0.20 

1.12 

0.25 

40471 

B 

0 

2 

4 

0.36 

0.19 

1.39 

-0.05 

40471 

C 

0 

1 

2 

-0.12 

0.00 

0.84 

-0.08 

40471 

D 

0 

2 

4 

-1.21 

0.64 

0.34 

-0.26 

40472 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.04 

40472 

A 

1 

47 

96 

0.63 

0.15 

0.89 

0.39 

40472 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40472 

C 

0 

1 

2 

-1.37 

0.00 

0.25 

-0.26 

40472 

D 

0 

1 

2 

-1.61 

0.00 

0.19 

-0.29 

40473 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.05 

40473 

A 

1 

51 

93 

0.58 

0.17 

0.85 

0.40 

40473 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40473 

C 

0 

4 

7 

-1.46 

0.47 

0.36 

-0.40 

40473 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40474 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.03 

40474 

A 

1 

43 

88 

0.79 

0.15 

0.81 

0.50 

40474 

B 

0 

2 

4 

-0.96 

1.18 

0.58 

-0.28 

40474 

C 

0 

2 

4 

-0.61 

0.17 

0.47 

-0.22 

40474 

D 

0 

2 

4 

-1.19 

0.42 

0.28 

-0.32 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40475 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40475 

A 

1 

51 

89 

0.82 

0.21 

1.16 

0.13 

40475 

B 

0 

5 

9 

0.34 

0.47 

1.81 

-0.09 

40475 

C 

0 

1 

2 

-0.36 

0.00 

0.62 

-0.10 

40475 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40476 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40476 

A 

1 

25 

45 

0.56 

0.19 

1.67 

0.02 

40476 

B 

0 

28 

50 

0.78 

0.19 

1.82 

0.20 

40476 

C 

0 

1 

2 

-0.33 

0.00 

0.37 

-0.09 

40476 

D 

0 

2 

4 

-2.99 

2.36 

0.28 

-0.54 

40477 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40477 

A 

1 

37 

67 

1.16 

0.14 

0.73 

0.62 

40477 

B 

0 

5 

9 

-0.02 

0.28 

0.75 

-0.15 

40477 

C 

0 

4 

7 

-0.36 

0.40 

0.59 

-0.21 

40477 

D 

0 

9 

16 

-0.88 

0.56 

0.51 

-0.51 

40478 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.00 

40478 

A 

1 

39 

72 

1.43 

0.14 

0.73 

0.66 

40478 

B 

0 

10 

19 

-0.01 

0.23 

0.59 

-0.43 

40478 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40478 

D 

0 

5 

9 

-0.55 

0.23 

0.31 

-0.44 

40479 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40479 

A 

1 

26 

46 

0.93 

0.22 

1.12 

0.38 

40479 

B 

0 

10 

18 

0.36 

0.19 

1.03 

-0.09 

40479 

C 

0 

8 

14 

-0.29 

0.18 

0.50 

-0.35 

40479 

D 

0 

12 

21 

0.39 

0.15 

0.98 

-0.08 

40480 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

40480 

A 

1 

40 

69 

1.13 

0.19 

0.90 

0.49 

40480 

B 

0 

7 

12 

-0.37 

0.25 

0.52 

-0.32 

40480 

C 

0 

6 

10 

0.25 

0.54 

1.66 

-0.13 

40480 

D 

0 

5 

9 

-0.52 

0.23 

0.42 

-0.30 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40481 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.02 

40481 

A 

1 

30 

59 

1.14 

0.20 

0.90 

0.46 

40481 

B 

0 

4 

8 

0.24 

0.39 

0.89 

-0.12 

40481 

C 

0 

9 

18 

0.48 

0.24 

1.23 

-0.09 

40481 

D 

0 

8 

16 

-0.45 

0.37 

0.64 

-0.44 

40482 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40482 

A 

1 

32 

55 

1.40 

0.20 

0.87 

0.63 

40482 

B 

0 

5 

9 

0.11 

0.25 

0.71 

-0.13 

40482 

C 

0 

5 

9 

-0.26 

0.38 

0.59 

-0.22 

40482 

D 

0 

16 

28 

-0.36 

0.25 

0.58 

-0.48 

40483 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40483 

A 

1 

50 

91 

0.66 

0.17 

1.11 

0.09 

40483 

B 

0 

3 

5 

0.18 

0.62 

1.45 

-0.09 

40483 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40483 

D 

0 

2 

4 

0.47 

0.45 

1.49 

-0.03 

40484 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.04 

40484 

A 

1 

31 

60 

0.91 

0.16 

1.02 

0.43 

40484 

B 

0 

13 

25 

0.46 

0.16 

1.12 

0.00 

40484 

C 

0 

4 

8 

-0.63 

0.43 

0.43 

-0.25 

40484 

D 

0 

4 

8 

-1.94 

1.20 

0.37 

-0.55 

40485 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.04 

40485 

A 

1 

31 

58 

1.03 

0.26 

1.07 

0.43 

40485 

B 

0 

8 

15 

0.43 

0.28 

1.51 

-0.02 

40485 

C 

0 

6 

11 

-0.84 

0.51 

0.56 

-0.33 

40485 

D 

0 

8 

15 

-0.46 

0.38 

0.65 

-0.28 

40486 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40486 

A 

1 

40 

74 

1.01 

0.17 

0.75 

0.60 

40486 

B 

0 

11 

20 

-0.56 

0.29 

0.64 

-0.43 

40486 

C 

0 

2 

4 

-1.82 

0.73 

0.17 

-0.36 

40486 

D 

0 

1 

2 

-1.05 

0.00 

0.28 

-0.17 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40487 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40487 

A 

1 

34 

62 

1.33 

0.19 

0.74 

0.59 

40487 

B 

0 

10 

18 

0.17 

0.31 

1.01 

-0.21 

40487 

C 

0 

2 

4 

-0.40 

0.89 

0.55 

-0.17 

40487 

D 

0 

9 

16 

-0.66 

0.22 

0.35 

-0.48 

40488 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.04 

40488 

A 

1 

36 

73 

1.15 

0.20 

0.74 

0.62 

40488 

B 

0 

5 

10 

-0.96 

0.48 

0.41 

-0.31 

40488 

C 

0 

1 

2 

0.39 

0.00 

1.11 

-0.01 

40488 

D 

0 

7 

14 

-1.47 

0.69 

0.39 

-0.51 

40489 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.04 

40489 

A 

1 

41 

85 

0.96 

0.20 

0.72 

0.66 

40489 

B 

0 

4 

8 

-2.28 

0.45 

0.18 

-0.53 

40489 

C 

0 

1 

2 

-0.66 

0.00 

0.66 

-0.11 

40489 

D 

0 

2 

4 

-2.06 

0.69 

0.20 

-0.34 

40490 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40490 

A 

1 

45 

83 

1.06 

0.19 

1.02 

0.30 

40490 

B 

0 

3 

6 

-0.67 

1.03 

0.76 

-0.29 

40490 

C 

0 

1 

2 

-0.34 

0.00 

0.47 

-0.13 

40490 

D 

0 

5 

9 

0.47 

0.35 

1.32 

-0.10 

40491 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40491 

A 

1 

31 

56 

1.58 

0.21 

0.82 

0.52 

40491 

B 

0 

12 

22 

0.38 

0.36 

2.44 

-0.14 

40491 

C 

0 

1 

2 

2.57 

0.00 

5.95 

0.14 

40491 

D 

0 

11 

20 

-0.99 

0.58 

0.59 

-0.54 

40492 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40492 

A 

1 

39 

71 

1.02 

0.16 

0.94 

0.33 

40492 

B 

0 

1 

2 

0.82 

0.00 

1.28 

0.01 

40492 

C 

0 

4 

7 

0.51 

0.37 

1.11 

-0.07 

40492 

D 

0 

11 

20 

0.00 

0.47 

1.21 

-0.34 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40493 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40493 

A 

1 

17 

31 

1.64 

0.32 

1.19 

0.44 

40493 

B 

0 

14 

25 

0.64 

0.29 

1.06 

-0.09 

40493 

C 

0 

7 

13 

0.87 

0.30 

1.07 

0.01 

40493 

D 

0 

17 

31 

0.17 

0.26 

0.57 

-0.36 

40494 

* 

-1 

4825 

99 

1.01 

0.02 

0.00 

0.05 

40494 

A 

1 

34 

58 

0.66 

0.20 

1.20 

0.32 

40494 

B 

0 

5 

8 

0.03 

0.37 

0.98 

-0.09 

40494 

C 

0 

6 

10 

-0.15 

0.26 

0.82 

-0.16 

40494 

D 

0 

14 

24 

-0.02 

0.25 

1.17 

-0.20 

40495 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40495 

A 

1 

48 

89 

0.79 

0.19 

0.94 

0.45 

40495 

B 

0 

2 

4 

-1.16 

0.25 

0.36 

-0.24 

40495 

C 

0 

1 

2 

-1.44 

0.00 

0.26 

-0.19 

40495 

D 

0 

3 

6 

-1.30 

1.00 

0.58 

-0.32 

40496 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40496 

A 

1 

39 

71 

0.89 

0.17 

0.90 

0.37 

40496 

B 

0 

2 

4 

1.18 

1.96 

8.19 

0.10 

40496 

C 

0 

11 

20 

-0.12 

0.24 

0.79 

-0.32 

40496 

D 

0 

3 

5 

-0.60 

0.70 

0.63 

-0.26 

40497 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.04 

40497 

A 

1 

43 

81 

0.87 

0.19 

0.95 

0.53 

40497 

B 

0 

5 

9 

-0.70 

0.23 

0.49 

-0.24 

40497 

C 

0 

2 

4 

-0.81 

1.16 

0.71 

-0.16 

40497 

D 

0 

3 

6 

-2.38 

1.61 

0.61 

-0.45 

40498 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

40498 

A 

1 

29 

55 

1.30 

0.22 

1.55 

0.54 

40498 

B 

0 

3 

6 

-0.29 

0.57 

0.50 

-0.20 

40498 

C 

0 

11 

21 

-0.02 

0.23 

0.65 

-0.31 

40498 

D 

0 

10 

19 

0.09 

0.30 

0.76 

-0.25 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40499 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40499 

A 

1 

47 

85 

0.83 

0.15 

0.77 

0.55 

40499 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40499 

C 

0 

2 

4 

-0.68 

0.17 

0.44 

-0.21 

40499 

D 

0 

6 

11 

-1.12 

0.45 

0.44 

-0.50 

40500 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40500 

A 

1 

39 

71 

1.06 

0.21 

1.55 

0.27 

40500 

B 

0 

3 

5 

1.49 

0.64 

3.66 

0.12 

40500 

C 

0 

8 

15 

-0.18 

0.35 

0.66 

-0.33 

40500 

D 

0 

5 

9 

0.35 

0.44 

1.30 

-0.12 

40501 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40501 

A 

1 

32 

58 

1.44 

0.21 

1.65 

0.61 

40501 

B 

0 

8 

15 

-0.22 

0.37 

0.60 

-0.27 

40501 

C 

0 

11 

20 

-0.14 

0.32 

0.70 

-0.29 

40501 

D 

0 

4 

7 

-1.03 

0.62 

0.33 

-0.34 

40502 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.00 

40502 

A 

1 

46 

85 

1.18 

0.14 

0.90 

0.41 

40502 

B 

0 

1 

2 

-1.17 

0.00 

0.16 

-0.29 

40502 

C 

0 

3 

6 

0.00 

0.41 

0.60 

-0.24 

40502 

D 

0 

4 

7 

0.30 

0.75 

1.82 

-0.19 

40503 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40503 

A 

1 

40 

70 

1.31 

0.20 

0.72 

0.60 

40503 

B 

0 

3 

5 

-0.39 

0.69 

0.76 

-0.17 

40503 

C 

0 

5 

9 

-0.59 

0.42 

0.53 

-0.27 

40503 

D 

0 

9 

16 

-0.82 

0.37 

0.49 

-0.44 

40504 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40504 

A 

1 

44 

80 

0.97 

0.17 

0.99 

0.43 

40504 

B 

0 

3 

5 

-0.01 

0.30 

0.71 

-0.16 

40504 

C 

0 

5 

9 

-0.09 

0.37 

0.75 

-0.23 

40504 

D 

0 

3 

5 

-0.68 

0.09 

0.34 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40505 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.04 

40505 

A 

1 

43 

73 

0.95 

0.13 

0.74 

0.66 

40505 

B 

0 

9 

15 

-0.75 

0.24 

0.44 

-0.50 

40505 

C 

0 

4 

7 

-0.51 

0.59 

0.72 

-0.25 

40505 

D 

0 

3 

5 

-0.55 

0.21 

0.45 

-0.23 

40506 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40506 

A 

1 

40 

74 

1.19 

0.19 

1.73 

0.44 

40506 

B 

0 

12 

22 

0.07 

0.23 

0.80 

-0.35 

40506 

C 

0 

1 

2 

0.44 

0.00 

0.84 

-0.05 

40506 

D 

0 

1 

2 

-1.88 

0.00 

0.08 

-0.31 

40507 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40507 

A 

1 

36 

65 

0.83 

0.16 

0.98 

0.33 

40507 

B 

0 

9 

16 

0.30 

0.34 

1.32 

-0.11 

40507 

C 

0 

7 

13 

-0.39 

0.48 

0.79 

-0.33 

40507 

D 

0 

3 

5 

0.44 

1.06 

2.86 

-0.03 

40508 

* 

-1 

4617 

95 

0.99 

0.02 

0.00 

-0.03 

40508 

A 

1 

213 

80 

1.40 

0.06 

0.84 

0.51 

40508 

B 

0 

29 

11 

0.17 

0.14 

0.63 

-0.33 

40508 

C 

0 

20 

7 

0.17 

0.20 

0.77 

-0.27 

40508 

D 

0 

5 

2 

-0.64 

0.32 

0.27 

-0.24 

40509 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40509 

A 

1 

34 

60 

1.35 

0.15 

0.72 

0.67 

40509 

B 

0 

6 

11 

-0.23 

0.31 

0.54 

-0.30 

40509 

C 

0 

9 

16 

0.16 

0.25 

0.83 

-0.22 

40509 

D 

0 

8 

14 

-0.50 

0.30 

0.44 

-0.45 

40510 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40510 

A 

1 

16 

29 

1.35 

0.31 

1.25 

0.38 

40510 

B 

0 

5 

9 

-0.07 

0.60 

0.70 

-0.20 

40510 

C 

0 

29 

53 

0.43 

0.18 

0.96 

-0.21 

40510 

D 

0 

5 

9 

0.45 

0.49 

0.99 

-0.05 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40511 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40511 

A 

1 

39 

71 

1.03 

0.17 

0.93 

0.46 

40511 

B 

0 

8 

15 

-0.26 

0.40 

0.69 

-0.24 

40511 

C 

0 

5 

9 

0.21 

0.76 

2.65 

-0.08 

40511 

D 

0 

3 

5 

-2.04 

1.77 

0.57 

-0.43 

40512 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40512 

A 

1 

33 

59 

1.00 

0.16 

0.86 

0.49 

40512 

B 

0 

3 

5 

-0.32 

0.93 

0.78 

-0.21 

40512 

C 

0 

15 

27 

0.12 

0.19 

0.85 

-0.27 

40512 

D 

0 

5 

9 

-0.32 

0.49 

0.73 

-0.27 

40513 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40513 

A 

1 

25 

46 

1.65 

0.26 

0.91 

0.57 

40513 

B 

0 

16 

30 

0.09 

0.32 

1.05 

-0.22 

40513 

C 

0 

6 

11 

-0.31 

0.39 

0.50 

-0.21 

40513 

D 

0 

7 

13 

-0.91 

0.72 

0.41 

-0.36 

40514 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

40514 

A 

1 

30 

61 

1.08 

0.27 

1.47 

0.26 

40514 

B 

0 

10 

20 

0.84 

0.24 

1.61 

0.01 

40514 

C 

0 

5 

10 

-0.30 

0.24 

0.47 

-0.29 

40514 

D 

0 

4 

8 

0.06 

0.32 

0.68 

-0.17 

40515 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40515 

A 

1 

43 

78 

1.19 

0.23 

0.87 

0.35 

40515 

B 

0 

4 

7 

0.02 

0.58 

1.14 

-0.16 

40515 

C 

0 

5 

9 

0.26 

0.81 

3.90 

-0.13 

40515 

D 

0 

3 

5 

-0.88 

0.43 

0.35 

-0.28 

40516 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40516 

A 

1 

35 

64 

0.90 

0.20 

1.29 

0.26 

40516 

B 

0 

14 

25 

0.27 

0.38 

3.25 

-0.17 

40516 

C 

0 

2 

4 

0.38 

0.29 

0.95 

-0.04 

40516 

D 

0 

4 

7 

-0.03 

0.77 

1.60 

-0.15 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40517 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.00 

40517 

A 

1 

50 

93 

1.00 

0.18 

1.11 

0.08 

40517 

B 

0 

1 

2 

1.02 

0.00 

1.79 

0.01 

40517 

C 

0 

2 

4 

0.67 

0.67 

1.55 

-0.05 

40517 

D 

0 

1 

2 

0.13 

0.00 

0.73 

-0.09 

40518 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40518 

A 

1 

52 

95 

0.86 

0.17 

0.83 

0.41 

40518 

B 

0 

1 

2 

-0.58 

0.00 

0.52 

-0.14 

40518 

C 

0 

2 

4 

-1.97 

0.57 

0.15 

-0.40 

40518 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40519 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40519 

A 

1 

34 

62 

1.18 

0.17 

0.99 

0.37 

40519 

B 

0 

16 

29 

0.54 

0.35 

1.46 

-0.10 

40519 

C 

0 

4 

7 

-0.38 

0.52 

0.47 

-0.23 

40519 

D 

0 

1 

2 

-4.95 

0.00 

0.00 

-0.55 

40520 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40520 

A 

1 

35 

65 

0.88 

0.17 

1.22 

0.19 

40520 

B 

0 

15 

28 

0.49 

0.42 

2.31 

-0.12 

40520 

C 

0 

3 

6 

-0.03 

0.61 

0.72 

-0.15 

40520 

D 

0 

1 

2 

0.43 

0.00 

0.86 

-0.03 

40521 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.01 

40521 

A 

1 

51 

82 

1.11 

0.15 

0.84 

0.47 

40521 

B 

0 

2 

3 

-1.07 

0.35 

0.22 

-0.30 

40521 

C 

0 

1 

2 

0.28 

0.00 

0.81 

-0.06 

40521 

D 

0 

8 

13 

-0.20 

0.34 

0.74 

-0.35 

40522 

* 

-1 

4831 

99 

0.99 

0.02 

0.00 

-0.02 

40522 

A 

1 

23 

43 

2.23 

0.27 

0.74 

0.62 

40522 

B 

0 

9 

17 

0.33 

0.19 

0.46 

-0.33 

40522 

C 

0 

16 

30 

0.83 

0.21 

0.96 

-0.23 

40522 

D 

0 

5 

9 

0.18 

0.59 

0.60 

-0.27 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40523 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40523 

A 

1 

26 

47 

1.77 

0.21 

0.52 

0.72 

40523 

B 

0 

15 

27 

-0.02 

0.26 

0.84 

-0.30 

40523 

C 

0 

3 

5 

-0.68 

0.33 

0.29 

-0.23 

40523 

D 

0 

11 

20 

-0.53 

0.25 

0.43 

-0.43 

40524 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40524 

A 

1 

47 

82 

0.85 

0.15 

0.83 

0.49 

40524 

B 

0 

7 

12 

-0.29 

0.32 

0.83 

-0.29 

40524 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40524 

D 

0 

3 

5 

-1.41 

0.64 

0.29 

-0.41 

40525 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40525 

A 

1 

28 

52 

1.21 

0.23 

0.83 

0.56 

40525 

B 

0 

23 

43 

-0.12 

0.18 

0.77 

-0.43 

40525 

C 

0 

1 

2 

-2.20 

0.00 

0.07 

-0.29 

40525 

D 

0 

2 

4 

-0.38 

0.57 

0.51 

-0.14 

40526 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.03 

40526 

A 

1 

14 

28 

1.90 

0.35 

0.72 

0.63 

40526 

B 

0 

12 

24 

-0.32 

0.24 

0.44 

-0.42 

40526 

C 

0 

6 

12 

0.52 

0.34 

0.94 

-0.03 

40526 

D 

0 

18 

36 

0.29 

0.19 

0.75 

-0.20 

40527 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.03 

40527 

A 

1 

59 

98 

0.63 

0.14 

0.99 

0.18 

40527 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40527 

C 

0 

1 

2 

-0.91 

0.00 

0.35 

-0.18 

40527 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40528 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40528 

A 

1 

51 

94 

0.77 

0.14 

0.85 

0.46 

40528 

B 

0 

1 

2 

-1.06 

0.00 

0.31 

-0.21 

40528 

C 

0 

2 

4 

-1.71 

0.05 

0.16 

-0.41 

40528 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40529 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.01 

40529 

A 

1 

51 

85 

1.14 

0.15 

0.84 

0.38 

40529 

B 

0 

3 

5 

0.68 

1.51 

8.19 

-0.05 

40529 

C 

0 

4 

7 

-0.93 

0.57 

0.33 

-0.39 

40529 

D 

0 

2 

3 

-0.17 

0.64 

0.63 

-0.16 

40530 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.02 

40530 

A 

1 

55 

90 

0.94 

0.15 

0.96 

0.44 

40530 

B 

0 

3 

5 

-0.63 

0.20 

0.41 

-0.28 

40530 

C 

0 

2 

3 

-1.02 

0.03 

0.27 

-0.29 

40530 

D 

0 

1 

2 

-0.58 

0.00 

0.41 

-0.15 

40531 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

40531 

A 

1 

15 

29 

1.73 

0.40 

1.59 

0.42 

40531 

B 

0 

7 

14 

0.32 

0.35 

0.62 

-0.20 

40531 

C 

0 

22 

43 

0.89 

0.16 

1.09 

-0.04 

40531 

D 

0 

7 

14 

0.03 

0.41 

0.55 

-0.30 

40532 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.01 

40532 

A 

1 

21 

34 

1.50 

0.28 

1.33 

0.40 

40532 

B 

0 

7 

11 

0.71 

0.30 

0.95 

-0.06 

40532 

C 

0 

21 

34 

0.52 

0.21 

0.91 

-0.24 

40532 

D 

0 

12 

20 

0.56 

0.25 

0.86 

-0.14 

40533 

* 

-1 

4829 

99 

1.01 

0.02 

0.00 

0.06 

40533 

A 

1 

22 

40 

1.19 

0.26 

0.90 

0.50 

40533 

B 

0 

10 

18 

0.14 

0.25 

0.95 

-0.05 

40533 

C 

0 

14 

25 

-0.05 

0.25 

0.90 

-0.14 

40533 

D 

0 

9 

16 

-1.15 

0.63 

0.46 

-0.44 

40534 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40534 

A 

1 

35 

64 

1.27 

0.19 

1.08 

0.47 

40534 

B 

0 

8 

15 

0.04 

0.21 

0.57 

-0.22 

40534 

C 

0 

4 

7 

0.92 

0.36 

1.46 

0.03 

40534 

D 

0 

8 

15 

-0.69 

0.71 

0.56 

-0.44 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40535 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40535 

A 

1 

27 

50 

1.20 

0.22 

0.84 

0.54 

40535 

B 

0 

9 

17 

-0.16 

0.38 

0.93 

-0.26 

40535 

C 

0 

8 

15 

-0.36 

0.37 

0.76 

-0.32 

40535 

D 

0 

10 

19 

0.14 

0.16 

0.76 

-0.16 

40536 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40536 

A 

1 

33 

60 

1.56 

0.30 

0.96 

0.44 

40536 

B 

0 

13 

24 

0.32 

0.20 

0.93 

-0.25 

40536 

C 

0 

3 

5 

0.55 

0.63 

1.28 

-0.07 

40536 

D 

0 

6 

11 

-0.26 

0.32 

0.55 

-0.29 

40537 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

40537 

A 

1 

18 

36 

1.54 

0.19 

0.79 

0.48 

40537 

B 

0 

4 

8 

0.66 

0.65 

1.23 

-0.05 

40537 

C 

0 

18 

36 

0.46 

0.22 

0.92 

-0.28 

40537 

D 

0 

10 

20 

0.43 

0.37 

0.89 

-0.20 

40538 

* 

-1 

4817 

99 

1.00 

0.02 

0.00 

0.03 

40538 

A 

1 

45 

67 

0.98 

0.18 

0.97 

0.40 

40538 

B 

0 

7 

10 

0.10 

0.30 

0.88 

-0.17 

40538 

C 

0 

2 

3 

0.09 

0.13 

0.70 

-0.09 

40538 

D 

0 

13 

19 

-0.01 

0.19 

0.76 

-0.30 

40539 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.00 

40539 

A 

1 

24 

44 

1.56 

0.23 

1.26 

0.43 

40539 

B 

0 

5 

9 

0.94 

0.31 

1.04 

-0.02 

40539 

C 

0 

16 

30 

0.58 

0.27 

0.98 

-0.25 

40539 

D 

0 

9 

17 

0.38 

0.27 

0.66 

-0.25 

40540 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40540 

A 

1 

27 

47 

1.63 

0.16 

0.66 

0.67 

40540 

B 

0 

15 

26 

0.20 

0.22 

0.79 

-0.30 

40540 

C 

0 

3 

5 

0.05 

0.51 

0.59 

-0.15 

40540 

D 

0 

12 

21 

-0.16 

0.30 

0.61 

-0.42 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40541 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.05 

40541 

A 

1 

48 

84 

0.63 

0.15 

0.98 

0.38 

40541 

B 

0 

4 

7 

-0.31 

0.47 

0.89 

-0.20 

40541 

C 

0 

2 

4 

-0.43 

0.97 

0.88 

-0.16 

40541 

D 

0 

3 

5 

-0.76 

0.34 

0.47 

-0.27 

40542 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.04 

40542 

A 

1 

36 

60 

1.06 

0.18 

0.87 

0.53 

40542 

B 

0 

3 

5 

-0.13 

0.34 

0.66 

-0.13 

40542 

C 

0 

20 

33 

-0.27 

0.22 

0.79 

-0.49 

40542 

D 

0 

1 

2 

0.59 

0.00 

1.18 

0.00 

40543 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40543 

A 

1 

48 

92 

0.87 

0.16 

0.92 

0.32 

40543 

B 

0 

2 

4 

-0.37 

0.06 

0.51 

-0.20 

40543 

C 

0 

1 

2 

-1.96 

0.00 

0.10 

-0.33 

40543 

D 

0 

1 

2 

0.70 

0.00 

1.49 

-0.01 

40544 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40544 

A 

1 

41 

79 

0.95 

0.18 

0.88 

0.42 

40544 

B 

0 

3 

6 

-0.55 

0.53 

0.53 

-0.27 

40544 

C 

0 

7 

13 

-0.04 

0.25 

0.79 

-0.26 

40544 

D 

0 

1 

2 

-0.59 

0.00 

0.38 

-0.16 

40545 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

40545 

A 

1 

40 

82 

0.89 

0.16 

1.03 

0.21 

40545 

B 

0 

8 

16 

0.41 

0.34 

1.50 

-0.16 

40545 

C 

0 

1 

2 

-0.34 

0.00 

0.43 

-0.16 

40545 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40546 

* 

-1 

4594 

94 

0.97 

0.02 

0.00 

-0.09 

40546 

A 

1 

230 

79 

1.76 

0.08 

0.89 

0.49 

40546 

B 

0 

12 

4 

0.54 

0.31 

1.03 

-0.15 

40546 

C 

0 

46 

16 

0.18 

0.13 

0.55 

-0.43 

40546 

D 

0 

2 

1 

-0.92 

0.05 

0.14 

-0.15 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40547 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.05 

40547 

A 

1 

26 

53 

0.95 

0.16 

0.86 

0.61 

40547 

B 

0 

5 

10 

-0.27 

0.32 

0.63 

-0.25 

40547 

C 

0 

11 

22 

-0.20 

0.21 

0.70 

-0.36 

40547 

D 

0 

7 

14 

-0.12 

0.29 

0.83 

-0.24 

40548 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.04 

40548 

A 

1 

39 

76 

0.74 

0.17 

1.05 

0.38 

40548 

B 

0 

8 

16 

-0.04 

0.21 

0.85 

-0.23 

40548 

C 

0 

4 

8 

-0.46 

0.08 

0.49 

-0.28 

40548 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40549 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.01 

40549 

A 

1 

46 

88 

0.96 

0.20 

1.03 

0.20 

40549 

B 

0 

4 

8 

0.34 

0.46 

1.33 

-0.12 

40549 

C 

0 

1 

2 

0.13 

0.00 

0.78 

-0.08 

40549 

D 

0 

1 

2 

-0.55 

0.00 

0.39 

-0.15 

40550 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.00 

40550 

A 

1 

28 

58 

1.63 

0.22 

1.00 

0.59 

40550 

B 

0 

16 

33 

0.08 

0.18 

0.58 

-0.50 

40550 

C 

0 

1 

2 

-0.13 

0.00 

0.37 

-0.13 

40550 

D 

0 

3 

6 

0.28 

0.94 

1.10 

-0.14 

40551 

* 

-1 

4842 

99 

1.00 

0.02 

0.00 

-0.02 

40551 

A 

1 

40 

95 

1.32 

0.22 

0.96 

0.25 

40551 

B 

0 

1 

2 

-0.43 

0.00 

0.35 

-0.19 

40551 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40551 

D 

0 

1 

2 

-0.23 

0.00 

0.43 

-0.16 

40552 

* 

-1 

4817 

99 

1.00 

0.02 

0.00 

0.01 

40552 

A 

1 

58 

87 

0.96 

0.13 

0.99 

0.26 

40552 

B 

0 

1 

1 

-0.57 

0.00 

0.33 

-0.18 

40552 

C 

0 

6 

9 

0.43 

0.46 

1.54 

-0.13 

40552 

D 

0 

2 

3 

-0.13 

0.46 

0.56 

-0.17 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40553 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40553 

A 

1 

40 

71 

0.96 

0.15 

0.85 

0.53 

40553 

B 

0 

11 

20 

-0.39 

0.33 

0.74 

-0.44 

40553 

C 

0 

3 

5 

-0.25 

0.19 

0.54 

-0.18 

40553 

D 

0 

2 

4 

-0.08 

0.34 

0.67 

-0.12 

40554 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.01 

40554 

A 

1 

47 

96 

0.95 

0.19 

0.97 

0.09 

40554 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40554 

C 

0 

2 

4 

0.38 

1.60 

2.60 

-0.09 

40554 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40555 

* 

-1 

4818 

99 

1.00 

0.02 

0.00 

0.01 

40555 

A 

1 

62 

94 

1.03 

0.13 

0.83 

0.42 

40555 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40555 

C 

0 

2 

3 

-1.67 

1.08 

0.21 

-0.40 

40555 

D 

0 

2 

3 

-0.23 

0.20 

0.54 

-0.18 

40556 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

40556 

A 

1 

47 

94 

1.05 

0.19 

0.77 

0.40 

40556 

B 

0 

1 

2 

-3.28 

0.00 

0.03 

-0.43 

40556 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40556 

D 

0 

2 

4 

-0.25 

0.34 

0.66 

-0.17 

40557 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40557 

A 

1 

42 

72 

0.83 

0.18 

1.08 

0.29 

40557 

B 

0 

5 

9 

-0.05 

0.77 

1.88 

-0.16 

40557 

C 

0 

8 

14 

0.07 

0.43 

1.12 

-0.17 

40557 

D 

0 

3 

5 

-0.03 

0.80 

1.07 

-0.12 

40558 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40558 

A 

1 

51 

94 

0.95 

0.17 

0.81 

0.31 

40558 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40558 

C 

0 

2 

4 

-1.04 

2.32 

1.49 

-0.29 

40558 

D 

0 

1 

2 

-0.23 

0.00 

0.65 

-0.12 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40559 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

-0.01 

40559 

A 

1 

47 

90 

1.22 

0.20 

0.99 

0.25 

40559 

B 

0 

4 

8 

-0.20 

0.60 

0.86 

-0.27 

40559 

C 

0 

1 

2 

1.04 

0.00 

1.73 

-0.01 

40559 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40560 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40560 

A 

1 

54 

96 

0.67 

0.16 

1.01 

0.15 

40560 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40560 

C 

0 

1 

2 

-1.42 

0.00 

0.22 

-0.24 

40560 

D 

0 

1 

2 

0.87 

0.00 

2.18 

0.03 

40561 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.05 

40561 

A 

1 

35 

61 

0.91 

0.19 

0.96 

0.53 

40561 

B 

0 

19 

33 

-0.45 

0.19 

0.68 

-0.51 

40561 

C 

0 

1 

2 

0.19 

0.00 

0.94 

-0.02 

40561 

D 

0 

2 

4 

-0.19 

0.57 

0.74 

-0.10 

40562 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.01 

40562 

A 

1 

36 

68 

1.48 

0.20 

0.73 

0.56 

40562 

B 

0 

10 

19 

0.37 

0.26 

0.97 

-0.18 

40562 

C 

0 

1 

2 

-0.32 

0.00 

0.38 

-0.11 

40562 

D 

0 

6 

11 

-1.41 

0.57 

0.25 

-0.56 

40563 

* 

-1 

4814 

99 

1.00 

0.02 

0.00 

0.00 

40563 

A 

1 

27 

39 

1.76 

0.18 

0.67 

0.60 

40563 

B 

0 

26 

37 

0.56 

0.15 

0.84 

-0.36 

40563 

C 

0 

9 

13 

0.72 

0.28 

1.00 

-0.12 

40563 

D 

0 

8 

11 

0.34 

0.12 

0.53 

-0.25 

40564 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40564 

A 

1 

57 

98 

0.69 

0.15 

0.93 

0.31 

40564 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40564 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40564 

D 

0 

1 

2 

-2.05 

0.00 

0.14 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40565 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.01 

40565 

A 

1 

54 

87 

0.98 

0.16 

0.96 

0.26 

40565 

B 

0 

2 

3 

0.06 

0.66 

0.86 

-0.12 

40565 

C 

0 

3 

5 

0.39 

0.63 

1.31 

-0.09 

40565 

D 

0 

3 

5 

-0.27 

0.97 

1.20 

-0.21 

40566 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

40566 

A 

1 

48 

96 

0.93 

0.15 

0.87 

0.39 

40566 

B 

0 

1 

2 

-0.38 

0.00 

0.50 

-0.16 

40566 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40566 

D 

0 

1 

2 

-2.05 

0.00 

0.09 

-0.38 

40567 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.04 

40567 

A 

1 

54 

90 

0.66 

0.15 

0.94 

0.31 

40567 

B 

0 

2 

3 

0.09 

0.82 

1.44 

-0.07 

40567 

C 

0 

1 

2 

-2.47 

0.00 

0.08 

-0.33 

40567 

D 

0 

3 

5 

-0.41 

0.61 

0.94 

-0.18 

40568 

* 

-1 

4818 

99 

1.00 

0.02 

0.00 

0.03 

40568 

A 

1 

62 

94 

0.77 

0.17 

0.96 

0.24 

40568 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40568 

C 

0 

3 

5 

-0.50 

0.78 

0.87 

-0.19 

40568 

D 

0 

1 

2 

-0.79 

0.00 

0.42 

-0.14 

40569 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40569 

A 

1 

43 

77 

0.80 

0.16 

0.83 

0.49 

40569 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40569 

C 

0 

11 

20 

-0.62 

0.32 

0.76 

-0.47 

40569 

D 

0 

2 

4 

-0.22 

0.58 

0.79 

-0.12 

40570 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.02 

40570 

A 

1 

54 

90 

0.88 

0.14 

0.99 

0.28 

40570 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40570 

C 

0 

2 

3 

-0.65 

0.19 

0.35 

-0.25 

40570 

D 

0 

4 

7 

0.17 

0.25 

0.85 

-0.16 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40571 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.01 

40571 

A 

1 

50 

86 

1.01 

0.16 

1.13 

0.18 

40571 

B 

0 

8 

14 

0.45 

0.13 

0.90 

-0.18 

40571 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40571 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40572 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

40572 

A 

1 

49 

96 

1.10 

0.20 

1.01 

0.20 

40572 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40572 

C 

0 

1 

2 

-0.86 

0.00 

0.30 

-0.19 

40572 

D 

0 

1 

2 

0.18 

0.00 

0.85 

-0.09 

40573 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.04 

40573 

A 

1 

46 

90 

0.79 

0.19 

0.79 

0.47 

40573 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40573 

C 

0 

2 

4 

-0.45 

0.09 

0.74 

-0.14 

40573 

D 

0 

3 

6 

-2.30 

1.45 

0.45 

-0.48 

40574 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40574 

A 

1 

51 

93 

0.69 

0.16 

0.95 

0.32 

40574 

B 

0 

1 

2 

-0.99 

0.00 

0.32 

-0.19 

40574 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40574 

D 

0 

3 

5 

-0.61 

0.45 

0.55 

-0.25 

40575 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

-0.01 

40575 

A 

1 

48 

96 

1.14 

0.16 

0.97 

0.22 

40575 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40575 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40575 

D 

0 

2 

4 

-0.09 

0.54 

0.53 

-0.22 

40576 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.01 

40576 

A 

1 

29 

48 

1.61 

0.28 

0.96 

0.47 

40576 

B 

0 

17 

28 

0.52 

0.27 

1.49 

-0.18 

40576 

C 

0 

8 

13 

-0.11 

0.32 

0.58 

-0.28 

40576 

D 

0 

6 

10 

0.05 

0.36 

0.63 

-0.20 
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Appendix  E:  Distractor  Statistics 


Item  ID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40577 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.01 

40577 

A 

1 

45 

73 

1.11 

0.18 

1.34 

0.34 

40577 

B 

0 

3 

5 

-0.41 

0.32 

0.42 

-0.23 

40577 

C 

0 

7 

11 

0.12 

0.35 

0.91 

-0.21 

40577 

D 

0 

7 

11 

0.46 

0.56 

1.54 

-0.11 

40578 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40578 

A 

1 

36 

64 

1.26 

0.19 

1.08 

0.41 

40578 

B 

0 

10 

18 

0.68 

0.31 

1.27 

-0.09 

40578 

C 

0 

2 

4 

0.18 

0.03 

0.57 

-0.12 

40578 

D 

0 

8 

14 

-0.20 

0.26 

0.48 

-0.39 

40579 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.03 

40579 

A 

1 

28 

45 

1.22 

0.25 

1.07 

0.39 

40579 

B 

0 

13 

21 

0.03 

0.33 

1.09 

-0.24 

40579 

C 

0 

5 

8 

0.14 

0.43 

0.88 

-0.12 

40579 

D 

0 

16 

26 

0.33 

0.30 

1.74 

-0.14 

40580 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

40580 

A 

1 

46 

90 

1.03 

0.16 

0.85 

0.45 

40580 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40580 

C 

0 

5 

10 

-0.68 

0.26 

0.38 

-0.45 

40580 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40581 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40581 

A 

1 

47 

87 

0.74 

0.13 

0.86 

0.48 

40581 

B 

0 

1 

2 

-1.22 

0.00 

0.24 

-0.24 

40581 

C 

0 

1 

2 

0.29 

0.00 

1.10 

-0.03 

40581 

D 

0 

5 

9 

-0.82 

0.53 

0.58 

-0.43 

40582 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

40582 

A 

1 

44 

88 

1.12 

0.22 

0.88 

0.46 

40582 

B 

0 

3 

6 

-1.15 

1.11 

0.52 

-0.28 

40582 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40582 

D 

0 

3 

6 

-1.62 

1.95 

1.13 

-0.35 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40583 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.00 

40583 

A 

1 

31 

49 

1.10 

0.18 

1.44 

0.11 

40583 

B 

0 

27 

43 

1.06 

0.19 

1.66 

0.06 

40583 

C 

0 

1 

2 

2.71 

0.00 

5.45 

0.19 

40583 

D 

0 

4 

6 

-0.98 

0.93 

0.45 

-0.44 

40584 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

40584 

A 

1 

27 

53 

1.21 

0.25 

1.32 

0.16 

40584 

B 

0 

16 

31 

1.20 

0.17 

1.74 

0.09 

40584 

C 

0 

1 

2 

-0.92 

0.00 

0.16 

-0.25 

40584 

D 

0 

7 

14 

0.35 

0.29 

0.71 

-0.25 

40585 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

40585 

A 

1 

49 

96 

0.94 

0.17 

0.86 

0.36 

40585 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40585 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40585 

D 

0 

2 

4 

-1.41 

1.06 

0.34 

-0.36 

40586 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.01 

40586 

A 

1 

48 

92 

1.14 

0.18 

0.93 

0.48 

40586 

B 

0 

1 

2 

-0.95 

0.00 

0.23 

-0.18 

40586 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40586 

D 

0 

3 

6 

-1.67 

1.47 

0.49 

-0.44 

40587 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40587 

A 

1 

43 

78 

1.41 

0.21 

0.84 

0.48 

40587 

B 

0 

9 

16 

-0.27 

0.27 

0.57 

-0.41 

40587 

C 

0 

2 

4 

-0.27 

0.50 

0.48 

-0.18 

40587 

D 

0 

1 

2 

0.19 

0.00 

0.67 

-0.08 

40588 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

40588 

A 

1 

33 

67 

1.22 

0.21 

1.05 

0.46 

40588 

B 

0 

1 

2 

-0.23 

0.00 

0.45 

-0.10 

40588 

C 

0 

10 

20 

0.44 

0.23 

1.08 

-0.12 

40588 

D 

0 

5 

10 

-1.35 

0.95 

0.35 

-0.50 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40589 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40589 

A 

1 

45 

83 

0.83 

0.16 

0.90 

0.51 

40589 

B 

0 

6 

11 

-1.46 

0.34 

0.26 

-0.58 

40589 

C 

0 

1 

2 

0.20 

0.00 

1.09 

-0.04 

40589 

D 

0 

2 

4 

0.45 

0.11 

1.41 

-0.02 

40590 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.02 

40590 

A 

1 

39 

76 

1.18 

0.21 

0.80 

0.53 

40590 

B 

0 

3 

6 

-0.26 

0.27 

0.61 

-0.19 

40590 

C 

0 

1 

2 

-1.42 

0.00 

0.18 

-0.22 

40590 

D 

0 

8 

16 

-0.53 

0.20 

0.50 

-0.41 

40591 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.03 

40591 

A 

1 

50 

83 

0.89 

0.15 

0.93 

0.40 

40591 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40591 

C 

0 

5 

8 

-0.36 

0.43 

0.70 

-0.28 

40591 

D 

0 

5 

8 

-0.27 

0.49 

0.89 

-0.26 

40592 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.00 

40592 

A 

1 

40 

82 

1.38 

0.18 

0.84 

0.53 

40592 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40592 

C 

0 

4 

8 

0.85 

0.24 

1.25 

-0.03 

40592 

D 

0 

5 

10 

-1.92 

0.83 

0.18 

-0.65 

40593 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40593 

A 

1 

43 

80 

0.97 

0.17 

0.86 

0.45 

40593 

B 

0 

10 

19 

-0.37 

0.31 

0.71 

-0.43 

40593 

C 

0 

1 

2 

-0.22 

0.00 

0.56 

-0.11 

40593 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40594 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40594 

A 

1 

51 

89 

0.67 

0.17 

0.99 

0.21 

40594 

B 

0 

3 

5 

-0.03 

0.71 

1.36 

-0.12 

40594 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40594 

D 

0 

3 

5 

-0.26 

0.72 

1.12 

-0.17 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40595 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

40595 

A 

1 

46 

90 

1.11 

0.20 

0.76 

0.51 

40595 

B 

0 

1 

2 

-1.35 

0.00 

0.22 

-0.21 

40595 

C 

0 

1 

2 

-1.32 

0.00 

0.23 

-0.21 

40595 

D 

0 

3 

6 

-1.48 

0.29 

0.21 

-0.39 

40596 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.02 

40596 

A 

1 

36 

71 

1.25 

0.25 

0.93 

0.47 

40596 

B 

0 

3 

6 

0.17 

0.58 

1.21 

-0.11 

40596 

C 

0 

8 

16 

-0.10 

0.22 

0.76 

-0.26 

40596 

D 

0 

4 

8 

-0.96 

0.16 

0.28 

-0.34 

40597 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

40597 

A 

1 

38 

67 

1.19 

0.22 

1.15 

0.34 

40597 

B 

0 

2 

4 

0.57 

0.11 

0.96 

-0.04 

40597 

C 

0 

14 

25 

0.30 

0.32 

1.33 

-0.24 

40597 

D 

0 

3 

5 

-0.29 

0.57 

0.57 

-0.21 

40598 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

-0.02 

40598 

A 

1 

37 

77 

1.36 

0.17 

1.16 

0.21 

40598 

B 

0 

2 

4 

1.08 

0.15 

1.06 

-0.04 

40598 

C 

0 

7 

15 

0.97 

0.22 

1.06 

-0.12 

40598 

D 

0 

2 

4 

0.32 

0.19 

0.50 

-0.20 

40599 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

40599 

A 

1 

36 

68 

1.36 

0.18 

0.72 

0.63 

40599 

B 

0 

11 

21 

-0.17 

0.21 

0.60 

-0.31 

40599 

C 

0 

1 

2 

-0.64 

0.00 

0.31 

-0.13 

40599 

D 

0 

5 

9 

-1.59 

0.85 

0.41 

-0.51 

40600 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.03 

40600 

A 

1 

17 

32 

1.10 

0.26 

1.17 

0.26 

40600 

B 

0 

14 

26 

0.25 

0.17 

0.66 

-0.20 

40600 

C 

0 

13 

25 

0.92 

0.25 

1.60 

0.13 

40600 

D 

0 

9 

17 

0.05 

0.66 

0.90 

-0.23 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


327 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40602 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40602 

A 

1 

50 

91 

0.88 

0.16 

1.06 

0.12 

40602 

B 

0 

1 

2 

1.11 

0.00 

2.00 

0.03 

40602 

C 

0 

2 

4 

0.97 

0.88 

2.46 

0.02 

40602 

D 

0 

2 

4 

-0.52 

0.38 

0.42 

-0.24 

40603 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.01 

40603 

A 

1 

52 

88 

1.02 

0.14 

0.85 

0.45 

40603 

B 

0 

5 

8 

-0.39 

0.45 

0.63 

-0.34 

40603 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40603 

D 

0 

2 

3 

-0.81 

0.50 

0.32 

-0.28 

40604 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40604 

A 

1 

49 

91 

0.88 

0.17 

0.85 

0.44 

40604 

B 

0 

1 

2 

-0.97 

0.00 

0.31 

-0.18 

40604 

C 

0 

3 

6 

-1.14 

0.32 

0.29 

-0.35 

40604 

D 

0 

1 

2 

-0.96 

0.00 

0.32 

-0.18 

40605 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

40605 

A 

1 

44 

90 

0.90 

0.18 

0.96 

0.28 

40605 

B 

0 

4 

8 

-0.12 

0.60 

0.93 

-0.22 

40605 

C 

0 

1 

2 

-0.77 

0.00 

0.35 

-0.18 

40605 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40606 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40606 

A 

1 

37 

67 

0.85 

0.18 

1.14 

0.27 

40606 

B 

0 

2 

4 

0.74 

0.54 

1.51 

0.02 

40606 

C 

0 

7 

13 

0.24 

0.47 

1.36 

-0.14 

40606 

D 

0 

9 

16 

0.09 

0.27 

0.90 

-0.23 

40607 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.03 

40607 

A 

1 

31 

48 

1.29 

0.27 

1.37 

0.43 

40607 

B 

0 

11 

17 

-0.17 

0.36 

0.75 

-0.26 

40607 

C 

0 

9 

14 

0.75 

0.35 

1.90 

0.03 

40607 

D 

0 

13 

20 

-0.26 

0.24 

0.71 

-0.32 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40608 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.02 

40608 

A 

1 

45 

90 

0.89 

0.17 

1.05 

0.30 

40608 

B 

0 

4 

8 

-0.37 

0.16 

0.51 

-0.30 

40608 

C 

0 

1 

2 

0.39 

0.00 

1.04 

-0.05 

40608 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40609 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.02 

40609 

A 

1 

57 

92 

0.83 

0.16 

1.00 

0.25 

40609 

B 

0 

5 

8 

-0.29 

0.38 

0.73 

-0.25 

40609 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40609 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40610 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

40610 

A 

1 

43 

84 

1.08 

0.20 

0.89 

0.40 

40610 

B 

0 

2 

4 

-0.01 

0.64 

0.85 

-0.13 

40610 

C 

0 

4 

8 

-0.44 

0.59 

0.64 

-0.28 

40610 

D 

0 

2 

4 

-0.69 

0.10 

0.36 

-0.23 

40611 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40611 

A 

1 

52 

96 

0.87 

0.18 

1.07 

0.15 

40611 

B 

0 

1 

2 

0.12 

0.00 

0.90 

-0.08 

40611 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40611 

D 

0 

1 

2 

-0.34 

0.00 

0.57 

-0.13 

40612 

* 

-1 

4635 

95 

0.99 

0.02 

0.00 

-0.03 

40612 

A 

1 

220 

88 

1.31 

0.07 

0.95 

0.36 

40612 

B 

0 

18 

7 

0.32 

0.16 

0.77 

-0.23 

40612 

C 

0 

9 

4 

0.06 

0.15 

0.52 

-0.20 

40612 

D 

0 

2 

1 

-1.18 

0.02 

0.14 

-0.20 

40613 

* 

-1 

4815 

99 

1.00 

0.02 

0.00 

0.01 

40613 

A 

1 

60 

87 

1.09 

0.16 

1.07 

0.43 

40613 

B 

0 

3 

4 

0.26 

0.18 

0.94 

-0.10 

40613 

C 

0 

4 

6 

-1.18 

0.29 

0.24 

-0.39 

40613 

D 

0 

2 

3 

-0.60 

0.53 

0.44 

-0.20 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40614 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.01 

40614 

A 

1 

46 

94 

0.95 

0.15 

0.96 

0.15 

40614 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40614 

C 

0 

3 

6 

0.26 

0.94 

1.64 

-0.15 

40614 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40615 

* 

-1 

4725 

97 

0.98 

0.02 

0.00 

-0.06 

40615 

A 

1 

117 

74 

1.72 

0.11 

0.95 

0.40 

40615 

B 

0 

29 

18 

0.85 

0.16 

1.26 

-0.23 

40615 

C 

0 

10 

6 

0.35 

0.26 

0.63 

-0.23 

40615 

D 

0 

3 

2 

-0.77 

0.34 

0.17 

-0.25 

40616 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40616 

A 

1 

52 

93 

0.76 

0.14 

0.87 

0.55 

40616 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40616 

C 

0 

1 

2 

-0.31 

0.00 

0.63 

-0.09 

40616 

D 

0 

3 

5 

-2.75 

1.79 

0.67 

-0.57 

40617 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.01 

40617 

A 

1 

40 

77 

1.25 

0.18 

0.70 

0.54 

40617 

B 

0 

2 

4 

-0.67 

1.98 

1.21 

-0.22 

40617 

C 

0 

6 

12 

-0.25 

0.43 

0.79 

-0.29 

40617 

D 

0 

4 

8 

-0.84 

0.64 

0.56 

-0.35 

40618 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40618 

A 

1 

28 

52 

1.38 

0.30 

0.94 

0.50 

40618 

B 

0 

10 

19 

0.18 

0.35 

1.37 

-0.15 

40618 

C 

0 

9 

17 

-0.31 

0.38 

0.70 

-0.28 

40618 

D 

0 

7 

13 

-0.34 

0.27 

0.58 

-0.25 

40619 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.01 

40619 

A 

1 

30 

58 

1.21 

0.23 

1.25 

0.34 

40619 

B 

0 

8 

15 

0.48 

0.36 

1.21 

-0.14 

40619 

C 

0 

8 

15 

0.31 

0.36 

0.88 

-0.20 

40619 

D 

0 

6 

12 

0.40 

0.41 

1.00 

-0.14 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40620 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

-0.01 

40620 

A 

1 

38 

62 

1.69 

0.20 

1.02 

0.51 

40620 

B 

0 

17 

28 

0.14 

0.27 

0.72 

-0.48 

40620 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40620 

D 

0 

6 

10 

0.70 

0.28 

0.91 

-0.11 

40621 

* 

-1 

4818 

99 

1.00 

0.02 

0.00 

0.01 

40621 

A 

1 

28 

42 

1.69 

0.20 

0.77 

0.55 

40621 

B 

0 

18 

27 

0.52 

0.23 

0.98 

-0.19 

40621 

C 

0 

9 

14 

0.52 

0.32 

0.97 

-0.13 

40621 

D 

0 

11 

17 

-0.15 

0.31 

0.52 

-0.38 

40622 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.01 

40622 

A 

1 

24 

41 

1.88 

0.29 

0.76 

0.54 

40622 

B 

0 

18 

31 

0.38 

0.27 

1.13 

-0.19 

40622 

C 

0 

7 

12 

0.02 

0.43 

0.68 

-0.19 

40622 

D 

0 

10 

17 

-0.23 

0.56 

0.73 

-0.30 

40623 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.02 

40623 

A 

1 

24 

41 

1.11 

0.29 

1.48 

0.21 

40623 

B 

0 

16 

27 

1.04 

0.25 

2.10 

0.12 

40623 

C 

0 

8 

14 

0.25 

0.36 

0.96 

-0.18 

40623 

D 

0 

11 

19 

0.22 

0.28 

0.77 

-0.23 

40624 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40624 

A 

1 

47 

84 

0.78 

0.18 

1.12 

0.31 

40624 

B 

0 

5 

9 

-0.19 

0.41 

0.91 

-0.21 

40624 

C 

0 

3 

5 

-0.46 

0.27 

0.53 

-0.21 

40624 

D 

0 

1 

2 

0.22 

0.00 

0.98 

-0.04 

40625 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40625 

A 

1 

44 

77 

1.19 

0.20 

0.92 

0.52 

40625 

B 

0 

10 

18 

-0.30 

0.22 

0.64 

-0.37 

40625 

C 

0 

2 

4 

-1.12 

0.37 

0.24 

-0.27 

40625 

D 

0 

1 

2 

-1.45 

0.00 

0.16 

-0.22 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40626 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.03 

40626 

A 

1 

46 

77 

1.05 

0.19 

0.99 

0.44 

40626 

B 

0 

12 

20 

-0.36 

0.26 

0.69 

-0.38 

40626 

C 

0 

1 

2 

1.09 

0.00 

2.17 

0.04 

40626 

D 

0 

1 

2 

-2.60 

0.00 

0.05 

-0.31 

40627 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40627 

A 

1 

31 

56 

1.11 

0.21 

1.07 

0.52 

40627 

B 

0 

7 

13 

0.07 

0.47 

1.30 

-0.16 

40627 

C 

0 

10 

18 

-0.20 

0.21 

0.64 

-0.30 

40627 

D 

0 

7 

13 

-0.28 

0.28 

0.62 

-0.27 

40628 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40628 

A 

1 

32 

58 

1.52 

0.20 

0.73 

0.60 

40628 

B 

0 

2 

4 

0.34 

0.14 

0.70 

-0.05 

40628 

C 

0 

13 

24 

0.28 

0.21 

0.79 

-0.18 

40628 

D 

0 

8 

15 

-1.44 

0.59 

0.26 

-0.60 

40629 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40629 

A 

1 

36 

69 

1.13 

0.22 

1.16 

0.38 

40629 

B 

0 

3 

6 

-0.15 

0.65 

0.74 

-0.18 

40629 

C 

0 

4 

8 

0.25 

0.26 

0.87 

-0.12 

40629 

D 

0 

9 

17 

0.08 

0.27 

0.87 

-0.26 

40630 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40630 

A 

1 

37 

69 

0.90 

0.15 

0.95 

0.48 

40630 

B 

0 

5 

9 

-0.44 

0.43 

0.57 

-0.30 

40630 

C 

0 

7 

13 

0.47 

0.24 

1.25 

-0.03 

40630 

D 

0 

5 

9 

-0.85 

0.43 

0.37 

-0.43 

40631 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40631 

A 

1 

27 

52 

1.55 

0.27 

0.84 

0.57 

40631 

B 

0 

11 

21 

0.08 

0.24 

0.82 

-0.26 

40631 

C 

0 

6 

12 

-0.20 

0.48 

0.78 

-0.26 

40631 

D 

0 

8 

15 

-0.09 

0.21 

0.59 

-0.27 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40632 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40632 

A 

1 

31 

55 

1.37 

0.22 

0.99 

0.46 

40632 

B 

0 

5 

9 

0.22 

0.40 

0.81 

-0.12 

40632 

C 

0 

9 

16 

0.49 

0.33 

1.17 

-0.09 

40632 

D 

0 

11 

20 

-0.40 

0.53 

0.87 

-0.41 

40633 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

40633 

A 

1 

25 

50 

1.55 

0.27 

0.78 

0.52 

40633 

B 

0 

5 

10 

0.46 

0.22 

0.86 

-0.09 

40633 

C 

0 

11 

22 

0.42 

0.21 

0.94 

-0.16 

40633 

D 

0 

9 

18 

-0.43 

0.48 

0.64 

-0.43 

40634 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

-0.02 

40634 

A 

1 

34 

65 

1.69 

0.25 

0.90 

0.50 

40634 

B 

0 

2 

4 

0.16 

0.29 

0.53 

-0.15 

40634 

C 

0 

6 

12 

-0.23 

0.18 

0.37 

-0.36 

40634 

D 

0 

10 

19 

0.52 

0.23 

0.98 

-0.23 

40635 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.03 

40635 

A 

1 

33 

62 

1.21 

0.25 

0.97 

0.54 

40635 

B 

0 

4 

8 

-1.01 

0.17 

0.27 

-0.32 

40635 

C 

0 

6 

11 

-0.57 

0.24 

0.46 

-0.29 

40635 

D 

0 

10 

19 

-0.05 

0.28 

0.98 

-0.22 

40636 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.02 

40636 

A 

1 

28 

43 

1.48 

0.18 

0.81 

0.51 

40636 

B 

0 

10 

15 

0.34 

0.33 

1.27 

-0.13 

40636 

C 

0 

14 

22 

0.08 

0.23 

0.62 

-0.26 

40636 

D 

0 

13 

20 

0.08 

0.48 

0.97 

-0.25 

40637 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

-0.01 

40637 

A 

1 

34 

64 

1.51 

0.21 

0.82 

0.47 

40637 

B 

0 

12 

23 

0.14 

0.28 

0.65 

-0.39 

40637 

C 

0 

1 

2 

-0.79 

0.00 

0.19 

-0.20 

40637 

D 

0 

6 

11 

0.66 

0.44 

1.20 

-0.11 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40638 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.04 

40638 

A 

1 

30 

48 

1.24 

0.29 

1.30 

0.41 

40638 

B 

0 

10 

16 

0.27 

0.32 

1.14 

-0.09 

40638 

C 

0 

7 

11 

-0.13 

0.43 

0.87 

-0.17 

40638 

D 

0 

15 

24 

-0.17 

0.38 

0.88 

-0.28 

40639 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.03 

40639 

A 

1 

46 

88 

0.88 

0.16 

0.91 

0.54 

40639 

B 

0 

1 

2 

1.54 

0.00 

3.97 

0.09 

40639 

C 

0 

3 

6 

-1.02 

1.32 

1.17 

-0.25 

40639 

D 

0 

2 

4 

-4.74 

0.23 

0.00 

-0.67 

40640 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.01 

40640 

A 

1 

49 

92 

0.96 

0.19 

0.93 

0.35 

40640 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40640 

C 

0 

3 

6 

-0.49 

0.80 

1.01 

-0.24 

40640 

D 

0 

1 

2 

-1.96 

0.00 

0.12 

-0.28 

40641 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.03 

40641 

A 

1 

47 

92 

0.73 

0.21 

0.93 

0.36 

40641 

B 

0 

1 

2 

-1.43 

0.00 

0.28 

-0.19 

40641 

C 

0 

2 

4 

-1.23 

0.27 

0.35 

-0.24 

40641 

D 

0 

1 

2 

-1.23 

0.00 

0.34 

-0.17 

40642 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.02 

40642 

A 

1 

54 

92 

0.86 

0.19 

1.08 

0.30 

40642 

B 

0 

2 

3 

-0.46 

0.19 

0.62 

-0.16 

40642 

C 

0 

1 

2 

0.66 

0.00 

1.87 

-0.01 

40642 

D 

0 

2 

3 

-1.60 

0.81 

0.26 

-0.30 

40643 

* 

-1 

4601 

94 

0.98 

0.02 

0.00 

-0.07 

40643 

A 

1 

271 

96 

1.44 

0.06 

0.88 

0.36 

40643 

B 

0 

8 

3 

-0.24 

0.25 

0.40 

-0.26 

40643 

C 

0 

3 

1 

-0.75 

1.16 

0.52 

-0.20 

40643 

D 

0 

1 

0 

-1.15 

0.00 

0.13 

-0.14 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40644 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40644 

A 

1 

49 

86 

0.98 

0.20 

0.90 

0.37 

40644 

B 

0 

4 

7 

-0.97 

0.32 

0.36 

-0.34 

40644 

C 

0 

3 

5 

-0.01 

0.82 

1.54 

-0.13 

40644 

D 

0 

1 

2 

-0.33 

0.00 

0.58 

-0.10 

40645 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40645 

A 

1 

43 

80 

0.97 

0.17 

1.11 

0.23 

40645 

B 

0 

9 

17 

0.09 

0.46 

1.55 

-0.28 

40645 

C 

0 

1 

2 

0.45 

0.00 

0.97 

-0.05 

40645 

D 

0 

1 

2 

2.12 

0.00 

5.15 

0.15 

40646 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40646 

A 

1 

41 

76 

0.83 

0.19 

1.88 

0.31 

40646 

B 

0 

1 

2 

-0.10 

0.00 

0.65 

-0.08 

40646 

C 

0 

4 

7 

0.21 

0.87 

2.32 

-0.09 

40646 

D 

0 

8 

15 

-0.21 

0.21 

0.68 

-0.28 

40647 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

0.00 

40647 

A 

1 

19 

40 

1.96 

0.30 

1.02 

0.60 

40647 

B 

0 

4 

9 

-0.20 

0.21 

0.29 

-0.29 

40647 

C 

0 

21 

45 

0.50 

0.20 

0.82 

-0.37 

40647 

D 

0 

3 

6 

0.49 

0.34 

0.61 

-0.11 

40648 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.02 

40648 

A 

1 

54 

86 

0.92 

0.16 

0.89 

0.34 

40648 

B 

0 

8 

13 

-0.48 

0.24 

0.52 

-0.39 

40648 

C 

0 

1 

2 

1.57 

0.00 

3.38 

0.09 

40648 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40649 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40649 

A 

1 

43 

80 

0.97 

0.19 

1.01 

0.49 

40649 

B 

0 

6 

11 

-0.42 

0.22 

0.58 

-0.29 

40649 

C 

0 

3 

6 

-0.72 

0.48 

0.48 

-0.26 

40649 

D 

0 

2 

4 

-1.02 

0.66 

0.34 

-0.25 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40650 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.01 

40650 

A 

1 

54 

89 

1.07 

0.17 

0.98 

0.29 

40650 

B 

0 

5 

8 

0.23 

0.20 

0.88 

-0.17 

40650 

C 

0 

1 

2 

-2.17 

0.00 

0.07 

-0.32 

40650 

D 

0 

1 

2 

0.40 

0.00 

0.96 

-0.05 

40651 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.02 

40651 

A 

1 

3 

5 

2.52 

1.43 

1.35 

0.31 

40651 

B 

0 

4 

7 

-0.44 

0.44 

0.18 

-0.25 

40651 

C 

0 

44 

73 

0.92 

0.17 

0.98 

0.18 

40651 

D 

0 

9 

15 

0.07 

0.40 

0.38 

-0.23 

40652 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.00 

40652 

A 

1 

16 

27 

2.03 

0.40 

1.44 

0.48 

40652 

B 

0 

9 

15 

1.33 

0.42 

1.78 

0.11 

40652 

C 

0 

22 

37 

0.39 

0.16 

0.59 

-0.35 

40652 

D 

0 

13 

22 

0.48 

0.24 

0.65 

-0.20 

40653 

* 

-1 

4826 

99 

1.01 

0.02 

0.00 

0.05 

40653 

A 

1 

51 

88 

0.67 

0.12 

0.87 

0.57 

40653 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40653 

C 

0 

4 

7 

-0.86 

0.33 

0.40 

-0.28 

40653 

D 

0 

3 

5 

-2.42 

1.71 

0.43 

-0.53 

40654 

* 

-1 

4817 

99 

1.00 

0.02 

0.00 

0.03 

40654 

A 

1 

63 

94 

0.81 

0.16 

0.81 

0.44 

40654 

B 

0 

2 

3 

-2.53 

0.01 

0.08 

-0.41 

40654 

C 

0 

2 

3 

-0.91 

0.23 

0.43 

-0.20 

40654 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40655 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40655 

A 

1 

50 

89 

1.06 

0.18 

0.78 

0.45 

40655 

B 

0 

3 

5 

-0.80 

0.42 

0.43 

-0.27 

40655 

C 

0 

1 

2 

-0.95 

0.00 

0.31 

-0.17 

40655 

D 

0 

2 

4 

-1.37 

2.02 

0.77 

-0.30 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40656 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40656 

A 

1 

49 

91 

0.73 

0.16 

0.86 

0.43 

40656 

B 

0 

1 

2 

-0.58 

0.00 

0.57 

-0.13 

40656 

C 

0 

3 

6 

-1.64 

0.85 

0.38 

-0.44 

40656 

D 

0 

1 

2 

0.01 

0.00 

1.03 

-0.06 

40657 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.03 

40657 

A 

1 

39 

63 

1.03 

0.19 

1.07 

0.37 

40657 

B 

0 

8 

13 

-0.50 

0.54 

0.84 

-0.36 

40657 

C 

0 

5 

8 

0.92 

0.23 

1.62 

0.06 

40657 

D 

0 

10 

16 

0.12 

0.27 

0.89 

-0.20 

40658 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40658 

A 

1 

40 

73 

0.77 

0.13 

0.93 

0.41 

40658 

B 

0 

2 

4 

0.97 

0.42 

1.92 

0.10 

40658 

C 

0 

5 

9 

-0.28 

0.33 

0.60 

-0.31 

40658 

D 

0 

8 

15 

-0.09 

0.23 

0.73 

-0.32 

40659 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

40659 

A 

1 

33 

58 

0.94 

0.21 

1.19 

0.38 

40659 

B 

0 

9 

16 

0.41 

0.34 

1.50 

-0.04 

40659 

C 

0 

4 

7 

0.62 

0.85 

2.50 

0.02 

40659 

D 

0 

11 

19 

-0.63 

0.25 

0.48 

-0.45 

40660 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40660 

A 

1 

43 

78 

1.18 

0.20 

0.98 

0.39 

40660 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40660 

C 

0 

6 

11 

0.16 

0.30 

0.87 

-0.20 

40660 

D 

0 

6 

11 

-0.31 

0.45 

0.82 

-0.32 

40661 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.04 

40661 

A 

1 

30 

52 

1.15 

0.19 

0.79 

0.54 

40661 

B 

0 

11 

19 

-0.25 

0.31 

0.74 

-0.33 

40661 

C 

0 

12 

21 

0.19 

0.16 

0.85 

-0.16 

40661 

D 

0 

5 

9 

-0.47 

0.62 

0.59 

-0.27 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40662 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40662 

A 

1 

14 

25 

1.32 

0.24 

0.80 

0.43 

40662 

B 

0 

21 

37 

0.50 

0.20 

0.98 

-0.08 

40662 

C 

0 

11 

19 

0.54 

0.25 

1.05 

-0.03 

40662 

D 

0 

11 

19 

-0.07 

0.24 

0.57 

-0.34 

40663 

* 

-1 

4634 

95 

0.98 

0.02 

0.00 

-0.06 

40663 

A 

1 

175 

70 

1.72 

0.08 

0.91 

0.49 

40663 

B 

0 

20 

8 

0.83 

0.10 

0.80 

-0.12 

40663 

C 

0 

46 

18 

0.63 

0.11 

0.75 

-0.27 

40663 

D 

0 

9 

4 

-1.69 

0.56 

0.12 

-0.48 

40664 

* 

-1 

4807 

98 

1.00 

0.02 

0.00 

0.00 

40664 

A 

1 

36 

47 

1.72 

0.23 

0.92 

0.49 

40664 

B 

0 

4 

5 

-0.28 

0.33 

0.36 

-0.23 

40664 

C 

0 

16 

21 

0.69 

0.25 

1.37 

-0.13 

40664 

D 

0 

21 

27 

0.38 

0.18 

0.83 

-0.31 

40665 

* 

-1 

4818 

99 

1.00 

0.02 

0.00 

0.02 

40665 

A 

1 

17 

26 

1.82 

0.43 

1.50 

0.41 

40665 

B 

0 

26 

39 

0.61 

0.26 

1.33 

-0.09 

40665 

C 

0 

5 

8 

0.00 

0.67 

0.73 

-0.15 

40665 

D 

0 

18 

27 

0.21 

0.24 

0.66 

-0.22 

40666 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40666 

A 

1 

46 

81 

0.94 

0.13 

0.88 

0.49 

40666 

B 

0 

1 

2 

-0.55 

0.00 

0.38 

-0.17 

40666 

C 

0 

3 

5 

0.02 

0.30 

0.73 

-0.16 

40666 

D 

0 

7 

12 

-0.41 

0.32 

0.61 

-0.42 

40667 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40667 

A 

1 

25 

45 

1.36 

0.26 

1.20 

0.50 

40667 

B 

0 

2 

4 

0.44 

0.30 

0.81 

-0.03 

40667 

C 

0 

16 

29 

0.36 

0.24 

1.15 

-0.16 

40667 

D 

0 

13 

23 

-0.25 

0.20 

0.50 

-0.40 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40668 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40668 

A 

1 

15 

27 

1.40 

0.39 

1.63 

0.37 

40668 

B 

0 

13 

24 

0.24 

0.30 

0.77 

-0.19 

40668 

C 

0 

9 

16 

0.72 

0.35 

1.32 

0.02 

40668 

D 

0 

18 

33 

0.33 

0.23 

0.78 

-0.19 

40669 

* 

-1 

4816 

99 

1.00 

0.02 

0.00 

0.03 

40669 

A 

1 

40 

59 

1.18 

0.18 

0.78 

0.51 

40669 

B 

0 

7 

10 

0.18 

0.39 

0.99 

-0.13 

40669 

C 

0 

12 

18 

-0.46 

0.30 

0.59 

-0.43 

40669 

D 

0 

9 

13 

0.20 

0.27 

1.02 

-0.15 

40670 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.03 

40670 

A 

1 

35 

67 

1.08 

0.21 

0.97 

0.47 

40670 

B 

0 

5 

10 

-0.24 

0.41 

0.72 

-0.23 

40670 

C 

0 

4 

8 

-0.41 

0.60 

0.72 

-0.24 

40670 

D 

0 

8 

15 

-0.12 

0.32 

0.84 

-0.26 

40671 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.00 

40671 

A 

1 

35 

63 

1.40 

0.25 

1.16 

0.40 

40671 

B 

0 

9 

16 

0.23 

0.18 

0.69 

-0.26 

40671 

C 

0 

5 

9 

0.21 

0.11 

0.61 

-0.19 

40671 

D 

0 

7 

13 

0.51 

0.17 

0.87 

-0.14 

40672 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.01 

40672 

A 

1 

30 

48 

1.35 

0.24 

0.97 

0.43 

40672 

B 

0 

27 

43 

0.36 

0.13 

0.85 

-0.36 

40672 

C 

0 

5 

8 

0.11 

0.29 

0.62 

-0.19 

40672 

D 

0 

1 

2 

1.88 

0.00 

3.12 

0.12 

40673 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.03 

40673 

A 

1 

20 

31 

1.46 

0.33 

1.01 

0.41 

40673 

B 

0 

41 

63 

0.30 

0.18 

1.11 

-0.34 

40673 

C 

0 

1 

2 

0.11 

0.00 

0.51 

-0.05 

40673 

D 

0 

3 

5 

0.03 

0.39 

0.55 

-0.10 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40674 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40674 

A 

1 

20 

35 

1.43 

0.32 

1.70 

0.40 

40674 

B 

0 

23 

40 

0.31 

0.22 

0.87 

-0.18 

40674 

C 

0 

10 

18 

0.65 

0.28 

1.27 

0.01 

40674 

D 

0 

4 

7 

-1.52 

1.14 

0.43 

-0.41 

40675 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.00 

40675 

A 

1 

47 

73 

1.27 

0.19 

1.02 

0.36 

40675 

B 

0 

3 

5 

-0.39 

0.50 

0.46 

-0.24 

40675 

C 

0 

5 

8 

0.08 

0.28 

0.65 

-0.21 

40675 

D 

0 

9 

14 

0.49 

0.37 

1.35 

-0.16 

40676 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

-0.02 

40676 

A 

1 

40 

77 

1.52 

0.19 

0.84 

0.50 

40676 

B 

0 

1 

2 

-0.67 

0.00 

0.23 

-0.21 

40676 

C 

0 

5 

10 

0.19 

0.30 

0.63 

-0.26 

40676 

D 

0 

6 

12 

0.07 

0.30 

0.57 

-0.32 

40677 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40677 

A 

1 

36 

65 

1.54 

0.21 

0.71 

0.57 

40677 

B 

0 

3 

5 

-0.21 

0.39 

0.50 

-0.13 

40677 

C 

0 

7 

13 

0.11 

0.52 

1.34 

-0.14 

40677 

D 

0 

9 

16 

-1.32 

0.80 

0.77 

-0.52 

40678 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

-0.01 

40678 

A 

1 

32 

49 

1.74 

0.28 

1.33 

0.46 

40678 

B 

0 

14 

22 

0.39 

0.17 

0.68 

-0.26 

40678 

C 

0 

8 

12 

0.55 

0.36 

1.01 

-0.15 

40678 

D 

0 

11 

17 

0.48 

0.23 

0.80 

-0.20 

40679 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40679 

A 

1 

27 

47 

1.66 

0.28 

0.82 

0.57 

40679 

B 

0 

3 

5 

0.59 

0.33 

1.02 

0.00 

40679 

C 

0 

14 

25 

0.08 

0.23 

0.75 

-0.17 

40679 

D 

0 

13 

23 

-0.99 

0.53 

0.53 

-0.50 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40680 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40680 

A 

1 

22 

40 

1.97 

0.34 

1.63 

0.54 

40680 

B 

0 

8 

15 

0.36 

0.32 

0.71 

-0.20 

40680 

C 

0 

16 

29 

0.36 

0.21 

0.70 

-0.30 

40680 

D 

0 

9 

16 

0.52 

0.33 

0.88 

-0.16 

40681 

* 

-1 

4826 

99 

1.01 

0.02 

0.00 

0.06 

40681 

A 

1 

21 

36 

1.27 

0.26 

0.82 

0.54 

40681 

B 

0 

5 

9 

0.33 

0.37 

1.05 

0.00 

40681 

C 

0 

25 

43 

-0.20 

0.20 

0.80 

-0.35 

40681 

D 

0 

7 

12 

-0.59 

0.49 

0.57 

-0.26 

40682 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40682 

A 

1 

19 

35 

1.19 

0.23 

0.93 

0.39 

40682 

B 

0 

12 

22 

0.57 

0.26 

1.17 

0.01 

40682 

C 

0 

11 

20 

-0.43 

0.45 

0.76 

-0.40 

40682 

D 

0 

12 

22 

0.35 

0.33 

1.31 

-0.08 

40683 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40683 

A 

1 

17 

31 

2.06 

0.41 

1.71 

0.46 

40683 

B 

0 

6 

11 

-0.67 

0.21 

0.17 

-0.34 

40683 

C 

0 

16 

29 

0.83 

0.24 

1.01 

-0.04 

40683 

D 

0 

16 

29 

0.44 

0.43 

0.85 

-0.19 

40684 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

40684 

A 

1 

42 

82 

1.24 

0.15 

0.90 

0.50 

40684 

B 

0 

1 

2 

-0.58 

0.00 

0.30 

-0.20 

40684 

C 

0 

3 

6 

-0.64 

0.25 

0.30 

-0.37 

40684 

D 

0 

5 

10 

0.14 

0.48 

0.92 

-0.25 

40685 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.00 

40685 

A 

1 

46 

73 

1.20 

0.18 

1.15 

0.27 

40685 

B 

0 

7 

11 

0.66 

0.44 

1.47 

-0.11 

40685 

C 

0 

5 

8 

0.25 

0.20 

0.66 

-0.19 

40685 

D 

0 

5 

8 

0.48 

0.58 

1.36 

-0.13 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40686 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

-0.01 

40686 

A 

1 

39 

71 

1.62 

0.19 

0.74 

0.50 

40686 

B 

0 

3 

5 

-0.64 

0.59 

0.34 

-0.30 

40686 

C 

0 

6 

11 

0.99 

0.51 

2.13 

-0.04 

40686 

D 

0 

7 

13 

-0.46 

0.51 

0.76 

-0.43 

40687 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.01 

40687 

A 

1 

25 

47 

1.64 

0.22 

0.77 

0.52 

40687 

B 

0 

15 

28 

0.67 

0.28 

1.31 

-0.07 

40687 

C 

0 

7 

13 

-0.03 

0.17 

0.44 

-0.23 

40687 

D 

0 

6 

11 

-1.16 

0.89 

0.34 

-0.48 

40688 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40688 

A 

1 

24 

43 

1.21 

0.25 

1.49 

0.41 

40688 

B 

0 

5 

9 

0.30 

0.53 

1.03 

-0.10 

40688 

C 

0 

16 

29 

0.53 

0.18 

1.02 

-0.08 

40688 

D 

0 

11 

20 

-0.09 

0.29 

0.62 

-0.34 

40689 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40689 

A 

1 

24 

44 

1.03 

0.20 

1.00 

0.40 

40689 

B 

0 

24 

44 

0.41 

0.17 

1.11 

-0.17 

40689 

C 

0 

2 

4 

0.20 

0.08 

0.66 

-0.08 

40689 

D 

0 

5 

9 

-0.47 

0.06 

0.34 

-0.35 

40690 

* 

-1 

4802 

98 

1.00 

0.02 

0.00 

0.01 

40690 

A 

1 

22 

27 

1.50 

0.29 

1.19 

0.33 

40690 

B 

0 

7 

9 

0.69 

0.26 

0.84 

-0.07 

40690 

C 

0 

40 

49 

0.80 

0.13 

1.04 

-0.14 

40690 

D 

0 

13 

16 

0.56 

0.23 

0.82 

-0.16 

40691 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40691 

A 

1 

40 

73 

1.08 

0.20 

0.92 

0.38 

40691 

B 

0 

6 

11 

0.37 

0.49 

1.76 

-0.11 

40691 

C 

0 

3 

5 

-0.32 

0.45 

0.55 

-0.21 

40691 

D 

0 

6 

11 

-0.23 

0.42 

0.80 

-0.28 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40692 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.05 

40692 

A 

1 

37 

66 

0.82 

0.18 

1.02 

0.46 

40692 

B 

0 

6 

11 

-0.45 

0.29 

0.59 

-0.28 

40692 

C 

0 

7 

13 

-0.22 

0.32 

0.89 

-0.23 

40692 

D 

0 

6 

11 

-0.15 

0.40 

0.95 

-0.19 

40693 

* 

-1 

4807 

98 

1.00 

0.02 

0.00 

0.02 

40693 

A 

1 

64 

83 

0.94 

0.16 

1.06 

0.32 

40693 

B 

0 

3 

4 

0.11 

0.59 

1.18 

-0.10 

40693 

C 

0 

5 

6 

-0.11 

0.34 

0.84 

-0.18 

40693 

D 

0 

5 

6 

-0.34 

0.32 

0.64 

-0.22 

40694 

* 

-1 

4814 

99 

1.00 

0.02 

0.00 

0.03 

40694 

A 

1 

45 

64 

1.29 

0.14 

0.73 

0.62 

40694 

B 

0 

11 

16 

-0.49 

0.29 

0.47 

-0.37 

40694 

C 

0 

9 

13 

-0.07 

0.36 

0.71 

-0.21 

40694 

D 

0 

5 

7 

-1.02 

1.01 

0.59 

-0.35 

40695 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.03 

40695 

A 

1 

42 

71 

1.03 

0.15 

0.97 

0.46 

40695 

B 

0 

9 

15 

0.24 

0.41 

1.25 

-0.11 

40695 

C 

0 

4 

7 

0.28 

0.30 

0.83 

-0.06 

40695 

D 

0 

4 

7 

-2.58 

1.28 

0.40 

-0.60 

40696 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40696 

A 

1 

32 

56 

1.01 

0.18 

0.89 

0.43 

40696 

B 

0 

10 

18 

0.09 

0.15 

0.71 

-0.21 

40696 

C 

0 

9 

16 

-0.17 

0.49 

0.97 

-0.29 

40696 

D 

0 

6 

11 

0.30 

0.47 

1.48 

-0.09 

40697 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40697 

A 

1 

49 

86 

0.93 

0.17 

0.98 

0.37 

40697 

B 

0 

2 

4 

0.18 

0.03 

0.87 

-0.09 

40697 

C 

0 

5 

9 

-0.63 

0.40 

0.55 

-0.35 

40697 

D 

0 

1 

2 

0.02 

0.00 

0.74 

-0.08 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


343 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40698 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40698 

A 

1 

29 

52 

1.30 

0.23 

1.10 

0.42 

40698 

B 

0 

7 

13 

-0.10 

0.48 

0.67 

-0.27 

40698 

C 

0 

14 

25 

0.67 

0.24 

1.33 

-0.06 

40698 

D 

0 

6 

11 

-0.32 

0.40 

0.53 

-0.31 

40699 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40699 

A 

1 

41 

73 

1.30 

0.27 

3.03 

0.46 

40699 

B 

0 

9 

16 

-0.14 

0.27 

0.79 

-0.23 

40699 

C 

0 

4 

7 

-0.42 

0.34 

0.52 

-0.19 

40699 

D 

0 

2 

4 

-2.68 

1.93 

0.32 

-0.38 

40700 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.02 

40700 

A 

1 

24 

41 

1.59 

0.21 

0.77 

0.52 

40700 

B 

0 

24 

41 

0.24 

0.25 

0.88 

-0.36 

40700 

C 

0 

5 

8 

0.43 

0.61 

1.05 

-0.09 

40700 

D 

0 

6 

10 

0.13 

0.43 

0.62 

-0.18 

40701 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40701 

A 

-1 

53 

98 

0.93 

0.18 

0.00 

0.57 

40701 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40701 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40701 

D 

-1 

1 

2 

-5.49 

0.00 

0.00 

-0.57 

40702 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40702 

A 

1 

55 

98 

0.51 

0.15 

1.12 

0.12 

40702 

B 

0 

1 

2 

-0.54 

0.00 

0.75 

-0.12 

40702 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40702 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40703 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40703 

A 

1 

53 

96 

0.91 

0.15 

0.95 

0.25 

40703 

B 

0 

1 

2 

0.29 

0.00 

0.92 

-0.07 

40703 

C 

0 

1 

2 

-1.41 

0.00 

0.17 

-0.29 

40703 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40704 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

-0.01 

40704 

A 

-1 

56 

100 

1.06 

0.14 

0.00 

0.00 

40704 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40704 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40704 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40705 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40705 

A 

-1 

54 

98 

0.75 

0.17 

0.00 

0.55 

40705 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40705 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40705 

D 

-1 

1 

2 

-5.49 

0.00 

0.00 

-0.55 

40706 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.03 

40706 

A 

1 

48 

94 

0.77 

0.17 

1.02 

0.28 

40706 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40706 

C 

0 

3 

6 

-0.65 

0.31 

0.51 

-0.28 

40706 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40707 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.02 

40707 

A 

1 

50 

98 

0.82 

0.19 

1.06 

0.06 

40707 

B 

0 

1 

2 

0.23 

0.00 

1.14 

-0.06 

40707 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40707 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40708 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40708 

A 

1 

54 

98 

0.89 

0.18 

1.03 

0.13 

40708 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40708 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40708 

D 

0 

1 

2 

-0.39 

0.00 

0.59 

-0.13 

40709 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

-0.01 

40709 

A 

1 

49 

98 

1.07 

0.19 

1.04 

0.00 

40709 

B 

0 

1 

2 

1.09 

0.00 

1.91 

0.00 

40709 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40709 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40710 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.00 

40710 

A 

1 

44 

76 

1.13 

0.16 

1.00 

0.26 

40710 

B 

0 

7 

12 

0.01 

0.40 

0.78 

-0.34 

40710 

C 

0 

2 

3 

0.93 

0.12 

1.26 

-0.01 

40710 

D 

0 

5 

9 

0.95 

0.28 

1.52 

-0.01 

40711 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40711 

A 

1 

49 

89 

0.69 

0.16 

0.96 

0.36 

40711 

B 

0 

3 

5 

-0.48 

0.50 

0.69 

-0.22 

40711 

C 

0 

1 

2 

-0.05 

0.00 

0.83 

-0.07 

40711 

D 

0 

2 

4 

-1.04 

0.24 

0.32 

-0.28 

40712 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.04 

40712 

A 

1 

58 

95 

0.65 

0.14 

1.01 

0.26 

40712 

B 

0 

1 

2 

-0.68 

0.00 

0.44 

-0.15 

40712 

C 

0 

1 

2 

-0.57 

0.00 

0.50 

-0.14 

40712 

D 

0 

1 

2 

-0.66 

0.00 

0.45 

-0.15 

40713 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.03 

40713 

A 

1 

41 

82 

0.83 

0.19 

0.95 

0.32 

40713 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40713 

C 

0 

5 

10 

-0.45 

0.74 

1.24 

-0.28 

40713 

D 

0 

4 

8 

0.05 

0.44 

1.03 

-0.14 

40714 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.04 

40714 

A 

1 

36 

72 

0.91 

0.19 

0.91 

0.49 

40714 

B 

0 

2 

4 

-0.70 

1.26 

0.76 

-0.19 

40714 

C 

0 

4 

8 

-1.21 

0.93 

0.72 

-0.38 

40714 

D 

0 

8 

16 

-0.18 

0.28 

0.87 

-0.22 

40715 

* 

-1 

4829 

99 

1.01 

0.02 

0.00 

0.05 

40715 

A 

1 

38 

69 

0.91 

0.17 

0.90 

0.51 

40715 

B 

0 

1 

2 

-1.94 

0.00 

0.11 

-0.20 

40715 

C 

0 

10 

18 

-0.01 

0.35 

1.39 

-0.11 

40715 

D 

0 

6 

11 

-2.06 

1.05 

0.50 

-0.53 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40716 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40716 

A 

1 

45 

79 

0.90 

0.16 

1.03 

0.33 

40716 

B 

0 

2 

4 

0.26 

1.36 

1.85 

-0.08 

40716 

C 

0 

3 

5 

-0.30 

0.46 

0.63 

-0.22 

40716 

D 

0 

7 

12 

0.05 

0.33 

0.98 

-0.22 

40717 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40717 

A 

1 

46 

84 

0.99 

0.16 

0.87 

0.47 

40717 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40717 

C 

0 

2 

4 

1.40 

1.03 

4.35 

0.10 

40717 

D 

0 

7 

13 

-1.48 

0.75 

0.45 

-0.57 

40718 

* 

-1 

4838 

99 

1.00 

0.02 

0.00 

-0.02 

40718 

A 

1 

38 

83 

1.46 

0.18 

0.99 

0.43 

40718 

B 

0 

1 

2 

0.01 

0.00 

0.43 

-0.16 

40718 

C 

0 

4 

9 

-0.39 

0.11 

0.29 

-0.44 

40718 

D 

0 

3 

7 

0.95 

0.28 

1.18 

-0.06 

40719 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40719 

A 

1 

42 

76 

1.02 

0.18 

0.94 

0.45 

40719 

B 

0 

1 

2 

-0.80 

0.00 

0.30 

-0.13 

40719 

C 

0 

3 

5 

0.21 

1.14 

2.37 

-0.07 

40719 

D 

0 

9 

16 

-0.78 

0.67 

0.76 

-0.43 

40720 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40720 

A 

1 

43 

78 

0.87 

0.20 

1.18 

0.14 

40720 

B 

0 

4 

7 

1.47 

0.38 

3.85 

0.15 

40720 

C 

0 

5 

9 

0.01 

0.45 

1.14 

-0.19 

40720 

D 

0 

3 

5 

-0.25 

1.26 

2.23 

-0.19 

40721 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

-0.01 

40721 

A 

1 

11 

19 

1.27 

0.24 

1.70 

0.06 

40721 

B 

0 

3 

5 

-0.63 

0.33 

0.13 

-0.34 

40721 

C 

0 

39 

67 

1.32 

0.19 

1.75 

0.24 

40721 

D 

0 

5 

9 

0.24 

0.49 

0.48 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40722 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.00 

40722 

A 

1 

42 

69 

1.21 

0.24 

1.48 

0.18 

40722 

B 

0 

7 

11 

0.86 

0.28 

1.48 

-0.05 

40722 

C 

0 

5 

8 

0.65 

0.70 

2.11 

-0.08 

40722 

D 

0 

7 

11 

0.48 

0.38 

1.20 

-0.15 

40723 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40723 

A 

1 

55 

98 

0.57 

0.12 

0.81 

0.46 

40723 

B 

0 

1 

2 

-2.75 

0.00 

0.07 

-0.46 

40723 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40723 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40724 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

40724 

A 

1 

47 

96 

0.92 

0.19 

1.03 

0.42 

40724 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40724 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40724 

D 

0 

2 

4 

-2.46 

3.03 

1.28 

-0.42 

40725 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.03 

40725 

A 

-1 

50 

100 

0.57 

0.18 

0.00 

0.00 

40725 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40725 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40725 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40726 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40726 

A 

1 

49 

91 

0.82 

0.18 

1.20 

0.10 

40726 

B 

0 

2 

4 

0.43 

0.79 

1.98 

-0.05 

40726 

C 

0 

3 

6 

0.28 

1.79 

10.47 

-0.09 

40726 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40727 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40727 

A 

-1 

55 

100 

0.66 

0.19 

0.00 

0.00 

40727 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40727 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40727 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40728 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40728 

A 

1 

53 

98 

0.47 

0.18 

1.05 

0.06 

40728 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40728 

C 

0 

1 

2 

-0.12 

0.00 

1.10 

-0.06 

40728 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40729 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

-0.01 

40729 

A 

1 

12 

23 

1.99 

0.37 

1.01 

0.42 

40729 

B 

0 

14 

26 

0.61 

0.31 

0.73 

-0.27 

40729 

C 

0 

23 

43 

1.14 

0.16 

1.01 

0.02 

40729 

D 

0 

4 

8 

0.09 

0.55 

0.45 

-0.25 

40730 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.03 

40730 

A 

1 

5 

10 

1.28 

0.21 

0.93 

0.18 

40730 

B 

0 

2 

4 

-0.52 

0.38 

0.21 

-0.19 

40730 

C 

0 

33 

65 

0.81 

0.21 

1.39 

0.21 

40730 

D 

0 

11 

22 

-0.03 

0.39 

0.63 

-0.28 

40731 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40731 

A 

1 

27 

50 

1.32 

0.23 

1.38 

0.28 

40731 

B 

0 

9 

17 

1.58 

0.34 

2.94 

0.20 

40731 

C 

0 

7 

13 

0.13 

0.37 

0.59 

-0.19 

40731 

D 

0 

11 

20 

-0.21 

0.66 

0.97 

-0.37 

40732 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40732 

A 

1 

31 

56 

1.22 

0.19 

1.21 

0.29 

40732 

B 

0 

12 

22 

1.01 

0.34 

2.01 

0.04 

40732 

C 

0 

5 

9 

0.52 

0.12 

0.73 

-0.11 

40732 

D 

0 

7 

13 

-0.27 

0.48 

0.63 

-0.39 

40733 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40733 

A 

1 

35 

65 

1.23 

0.22 

1.10 

0.37 

40733 

B 

0 

4 

7 

0.34 

0.26 

0.84 

-0.12 

40733 

C 

0 

6 

11 

0.52 

0.61 

2.31 

-0.10 

40733 

D 

0 

9 

17 

0.04 

0.28 

0.74 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40734 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.02 

40734 

A 

1 

40 

78 

0.83 

0.20 

1.68 

0.19 

40734 

B 

0 

2 

4 

1.23 

0.32 

2.41 

0.08 

40734 

C 

0 

5 

10 

0.65 

0.22 

1.42 

-0.02 

40734 

D 

0 

4 

8 

-0.68 

0.85 

0.77 

-0.33 

40735 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40735 

A 

1 

40 

73 

0.96 

0.19 

1.39 

0.21 

40735 

B 

0 

13 

24 

0.63 

0.25 

1.45 

-0.08 

40735 

C 

0 

1 

2 

-1.87 

0.00 

0.09 

-0.32 

40735 

D 

0 

1 

2 

-0.29 

0.00 

0.42 

-0.13 

40736 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40736 

A 

1 

28 

51 

1.50 

0.33 

1.22 

0.40 

40736 

B 

0 

20 

36 

0.64 

0.15 

1.22 

-0.09 

40736 

C 

0 

5 

9 

-0.73 

0.49 

0.39 

-0.29 

40736 

D 

0 

2 

4 

-2.63 

2.46 

0.43 

-0.40 

40737 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40737 

A 

1 

40 

73 

1.16 

0.17 

1.06 

0.30 

40737 

B 

0 

9 

16 

0.58 

0.22 

0.99 

-0.17 

40737 

C 

0 

1 

2 

0.49 

0.00 

0.77 

-0.07 

40737 

D 

0 

5 

9 

0.31 

0.39 

0.88 

-0.21 

40738 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.00 

40738 

A 

1 

41 

79 

1.31 

0.20 

0.85 

0.51 

40738 

B 

0 

3 

6 

0.01 

0.35 

0.70 

-0.17 

40738 

C 

0 

3 

6 

-0.66 

0.48 

0.40 

-0.30 

40738 

D 

0 

5 

10 

-0.42 

0.32 

0.49 

-0.33 

40739 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

-0.02 

40739 

A 

1 

26 

51 

1.91 

0.22 

0.76 

0.54 

40739 

B 

0 

4 

8 

1.30 

0.27 

1.29 

0.02 

40739 

C 

0 

21 

41 

0.33 

0.26 

0.82 

-0.56 

40739 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40740 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40740 

A 

1 

25 

46 

1.28 

0.17 

0.80 

0.45 

40740 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40740 

C 

0 

28 

52 

0.31 

0.22 

1.12 

-0.38 

40740 

D 

0 

1 

2 

-1.27 

0.00 

0.13 

-0.24 

40741 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

-0.01 

40741 

A 

1 

46 

98 

1.12 

0.15 

0.98 

0.24 

40741 

B 

0 

1 

2 

-0.55 

0.00 

0.29 

-0.24 

40741 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40741 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40742 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40742 

A 

1 

50 

91 

0.99 

0.16 

1.08 

0.28 

40742 

B 

0 

4 

7 

0.09 

0.19 

0.72 

-0.20 

40742 

C 

0 

1 

2 

-0.79 

0.00 

0.28 

-0.21 

40742 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40743 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40743 

A 

1 

35 

64 

0.86 

0.22 

1.24 

0.33 

40743 

B 

0 

6 

11 

0.10 

0.68 

1.66 

-0.09 

40743 

C 

0 

5 

9 

-0.51 

0.41 

0.57 

-0.21 

40743 

D 

0 

9 

16 

-0.22 

0.71 

1.46 

-0.20 

40744 

* 

-1 

4829 

99 

1.01 

0.02 

0.00 

0.08 

40744 

A 

1 

39 

71 

0.54 

0.17 

1.02 

0.44 

40744 

B 

0 

6 

11 

-0.54 

0.54 

1.13 

-0.14 

40744 

C 

0 

1 

2 

2.23 

0.00 

8.81 

0.18 

40744 

D 

0 

9 

16 

-1.67 

0.79 

0.75 

-0.49 

40745 

* 

-1 

4838 

99 

1.00 

0.02 

0.00 

0.01 

40745 

A 

1 

41 

89 

0.93 

0.17 

1.03 

0.18 

40745 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40745 

C 

0 

5 

11 

0.31 

0.54 

1.49 

-0.18 

40745 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40746 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

-0.01 

40746 

A 

-1 

50 

100 

1.10 

0.18 

0.00 

0.00 

40746 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40746 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40746 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40747 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40747 

A 

1 

52 

96 

1.04 

0.20 

0.69 

0.48 

40747 

B 

0 

1 

2 

-2.84 

0.00 

0.07 

-0.33 

40747 

C 

0 

1 

2 

-3.09 

0.00 

0.06 

-0.35 

40747 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40748 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40748 

A 

1 

51 

93 

0.69 

0.22 

0.91 

0.38 

40748 

B 

0 

1 

2 

-0.48 

0.00 

0.87 

-0.08 

40748 

C 

0 

1 

2 

-2.05 

0.00 

0.18 

-0.21 

40748 

D 

0 

2 

4 

-2.14 

0.89 

0.24 

-0.31 

40749 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40749 

A 

1 

50 

93 

0.82 

0.18 

1.06 

0.15 

40749 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40749 

C 

0 

4 

7 

0.09 

0.30 

0.96 

-0.15 

40749 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40750 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40750 

A 

1 

51 

93 

0.89 

0.17 

0.98 

0.57 

40750 

B 

0 

1 

2 

-1.20 

0.00 

0.29 

-0.16 

40750 

C 

0 

1 

2 

-2.89 

0.00 

0.05 

-0.31 

40750 

D 

0 

2 

4 

-2.94 

2.87 

0.90 

-0.45 

40751 

* 

-1 

4839 

99 

1.00 

0.02 

0.00 

-0.02 

40751 

A 

1 

11 

24 

1.63 

0.36 

1.84 

0.17 

40751 

B 

0 

1 

2 

0.56 

0.00 

0.37 

-0.10 

40751 

C 

0 

11 

24 

1.49 

0.19 

1.17 

0.10 

40751 

D 

0 

22 

49 

1.06 

0.27 

1.46 

-0.21 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40752 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.02 

40752 

A 

1 

44 

69 

1.08 

0.17 

1.22 

0.35 

40752 

B 

0 

8 

13 

0.09 

0.47 

0.96 

-0.25 

40752 

C 

0 

7 

11 

0.24 

0.31 

0.90 

-0.18 

40752 

D 

0 

5 

8 

0.47 

0.22 

0.94 

-0.09 

40753 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40753 

A 

1 

29 

53 

1.67 

0.28 

1.17 

0.55 

40753 

B 

0 

6 

11 

-0.06 

0.21 

0.48 

-0.16 

40753 

C 

0 

8 

15 

-0.07 

0.29 

0.56 

-0.19 

40753 

D 

0 

12 

22 

-0.59 

0.64 

0.82 

-0.39 

40754 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

-0.01 

40754 

A 

1 

5 

9 

2.42 

0.53 

0.83 

0.28 

40754 

B 

0 

6 

11 

1.40 

0.27 

0.84 

0.07 

40754 

C 

0 

19 

34 

1.10 

0.27 

0.93 

0.00 

40754 

D 

0 

26 

46 

0.78 

0.34 

1.35 

-0.20 

40755 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40755 

A 

1 

9 

16 

0.79 

0.29 

1.70 

0.02 

40755 

B 

0 

8 

14 

0.65 

0.45 

1.25 

-0.04 

40755 

C 

0 

12 

21 

0.62 

0.28 

0.95 

-0.07 

40755 

D 

0 

27 

48 

0.83 

0.20 

1.19 

0.07 

40756 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40756 

A 

1 

9 

17 

1.02 

0.37 

1.32 

0.20 

40756 

B 

0 

20 

37 

0.50 

0.18 

0.94 

-0.02 

40756 

C 

0 

10 

19 

0.50 

0.25 

0.90 

-0.01 

40756 

D 

0 

15 

28 

0.31 

0.41 

1.12 

-0.13 

40757 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40757 

A 

1 

45 

82 

1.31 

0.17 

0.91 

0.49 

40757 

B 

0 

1 

2 

0.47 

0.00 

0.81 

-0.05 

40757 

C 

0 

7 

13 

-0.15 

0.41 

0.67 

-0.29 

40757 

D 

0 

2 

4 

-2.55 

2.80 

0.65 

-0.46 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40758 

* 

-1 

4826 

99 

1.01 

0.02 

0.00 

0.05 

40758 

A 

1 

30 

52 

1.35 

0.15 

0.61 

0.67 

40758 

B 

0 

3 

5 

-0.59 

0.33 

0.38 

-0.16 

40758 

C 

0 

10 

17 

-0.15 

0.22 

0.64 

-0.17 

40758 

D 

0 

15 

26 

-0.97 

0.43 

0.55 

-0.55 

40759 

* 

-1 

4827 

99 

1.01 

0.02 

0.00 

0.06 

40759 

A 

1 

30 

53 

0.92 

0.23 

1.01 

0.50 

40759 

B 

0 

4 

7 

0.07 

0.55 

1.21 

-0.05 

40759 

C 

0 

9 

16 

-0.85 

0.35 

0.48 

-0.37 

40759 

D 

0 

14 

25 

-0.24 

0.28 

0.88 

-0.23 

40760 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40760 

A 

1 

28 

51 

1.41 

0.20 

0.84 

0.56 

40760 

B 

0 

6 

11 

0.20 

0.40 

0.83 

-0.07 

40760 

C 

0 

3 

5 

0.68 

0.21 

1.02 

0.02 

40760 

D 

0 

18 

33 

-0.77 

0.42 

0.59 

-0.56 

40761 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.05 

40761 

A 

1 

33 

59 

1.20 

0.19 

0.79 

0.55 

40761 

B 

0 

7 

13 

-0.25 

0.56 

1.20 

-0.14 

40761 

C 

0 

5 

9 

-0.42 

0.61 

0.79 

-0.15 

40761 

D 

0 

11 

20 

-1.19 

0.68 

0.72 

-0.46 

40762 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40762 

A 

1 

25 

44 

1.21 

0.24 

1.12 

0.41 

40762 

B 

0 

21 

37 

0.16 

0.22 

0.88 

-0.32 

40762 

C 

0 

6 

11 

0.68 

0.60 

2.01 

0.01 

40762 

D 

0 

5 

9 

-0.06 

0.18 

0.49 

-0.18 

40763 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40763 

A 

1 

30 

58 

1.38 

0.15 

0.77 

0.61 

40763 

B 

0 

2 

4 

0.70 

0.54 

1.09 

-0.02 

40763 

C 

0 

14 

27 

0.13 

0.28 

0.79 

-0.38 

40763 

D 

0 

6 

12 

-0.42 

0.17 

0.33 

-0.41 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40764 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.01 

40764 

A 

1 

28 

53 

1.72 

0.27 

0.84 

0.59 

40764 

B 

0 

15 

28 

0.12 

0.22 

0.72 

-0.34 

40764 

C 

0 

7 

13 

-0.50 

0.27 

0.35 

-0.37 

40764 

D 

0 

3 

6 

0.47 

0.51 

0.94 

-0.07 

40765 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40765 

A 

1 

37 

67 

0.99 

0.19 

1.11 

0.47 

40765 

B 

0 

8 

15 

-0.17 

0.28 

0.73 

-0.26 

40765 

C 

0 

5 

9 

0.26 

0.32 

1.02 

-0.09 

40765 

D 

0 

5 

9 

-0.72 

0.38 

0.42 

-0.35 

40766 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40766 

A 

1 

13 

22 

1.34 

0.26 

1.00 

0.31 

40766 

B 

0 

3 

5 

0.29 

0.27 

0.54 

-0.07 

40766 

C 

0 

15 

26 

1.00 

0.23 

1.38 

0.17 

40766 

D 

0 

27 

47 

0.18 

0.25 

0.77 

-0.37 

40767 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.04 

40767 

A 

1 

42 

66 

1.10 

0.18 

0.80 

0.60 

40767 

B 

0 

4 

6 

-0.28 

0.48 

0.74 

-0.16 

40767 

C 

0 

12 

19 

-0.75 

0.24 

0.44 

-0.48 

40767 

D 

0 

6 

9 

-0.31 

0.32 

0.69 

-0.21 

40768 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.04 

40768 

A 

1 

49 

80 

0.86 

0.14 

0.84 

0.57 

40768 

B 

0 

3 

5 

-0.86 

0.43 

0.39 

-0.24 

40768 

C 

0 

3 

5 

-0.62 

0.25 

0.44 

-0.20 

40768 

D 

0 

6 

10 

-1.27 

0.86 

0.62 

-0.45 

40769 

* 

-1 

4816 

99 

1.01 

0.02 

0.00 

0.05 

40769 

A 

1 

47 

69 

1.04 

0.14 

0.71 

0.62 

40769 

B 

0 

6 

9 

-1.13 

0.37 

0.33 

-0.35 

40769 

C 

0 

8 

12 

-0.28 

0.35 

0.76 

-0.19 

40769 

D 

0 

7 

10 

-1.31 

0.77 

0.69 

-0.42 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40770 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.03 

40770 

A 

1 

46 

78 

0.90 

0.16 

1.07 

0.39 

40770 

B 

0 

4 

7 

0.44 

0.17 

1.03 

-0.04 

40770 

C 

0 

2 

3 

-0.30 

0.13 

0.48 

-0.13 

40770 

D 

0 

7 

12 

-0.81 

0.86 

1.10 

-0.40 

40771 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40771 

A 

1 

48 

86 

0.90 

0.18 

0.96 

0.31 

40771 

B 

0 

5 

9 

-0.37 

0.37 

0.65 

-0.28 

40771 

C 

0 

2 

4 

0.58 

0.82 

1.81 

-0.02 

40771 

D 

0 

1 

2 

-0.94 

0.00 

0.29 

-0.18 

40772 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.00 

40772 

A 

1 

14 

28 

1.99 

0.30 

0.85 

0.50 

40772 

B 

0 

14 

28 

0.76 

0.26 

0.91 

-0.16 

40772 

C 

0 

4 

8 

0.70 

0.33 

0.67 

-0.09 

40772 

D 

0 

18 

36 

0.65 

0.25 

0.92 

-0.27 

40773 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

-0.02 

40773 

A 

1 

47 

82 

1.54 

0.15 

0.70 

0.63 

40773 

B 

0 

1 

2 

-0.30 

0.00 

0.34 

-0.16 

40773 

C 

0 

4 

7 

0.06 

0.09 

0.49 

-0.25 

40773 

D 

0 

5 

9 

-1.02 

0.47 

0.25 

-0.55 

40774 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.04 

40774 

A 

1 

48 

79 

0.89 

0.17 

0.95 

0.47 

40774 

B 

0 

1 

2 

0.29 

0.00 

1.09 

-0.03 

40774 

C 

0 

8 

13 

-0.50 

0.27 

0.61 

-0.34 

40774 

D 

0 

4 

7 

-0.76 

0.23 

0.41 

-0.29 

40775 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.02 

40775 

A 

1 

33 

56 

1.51 

0.18 

0.72 

0.64 

40775 

B 

0 

13 

22 

-0.17 

0.19 

0.49 

-0.43 

40775 

C 

0 

8 

14 

-0.02 

0.40 

0.67 

-0.27 

40775 

D 

0 

5 

8 

0.10 

0.44 

0.79 

-0.18 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40776 

* 

-1 

4627 

95 

0.98 

0.02 

0.00 

-0.07 

40776 

A 

1 

118 

46 

2.14 

0.10 

0.77 

0.55 

40776 

B 

0 

71 

28 

0.96 

0.11 

0.90 

-0.20 

40776 

C 

0 

53 

21 

0.78 

0.10 

0.66 

-0.23 

40776 

D 

0 

15 

6 

-0.60 

0.51 

0.37 

-0.38 

40777 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.03 

40777 

A 

1 

32 

54 

1.43 

0.24 

0.79 

0.55 

40777 

B 

0 

11 

19 

-0.21 

0.18 

0.55 

-0.24 

40777 

C 

0 

10 

17 

0.16 

0.47 

2.13 

-0.12 

40777 

D 

0 

6 

10 

-1.55 

0.77 

0.27 

-0.45 

40778 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40778 

A 

1 

21 

39 

1.69 

0.28 

0.76 

0.58 

40778 

B 

0 

8 

15 

0.24 

0.31 

0.74 

-0.19 

40778 

C 

0 

16 

30 

0.13 

0.18 

0.66 

-0.35 

40778 

D 

0 

9 

17 

0.37 

0.30 

0.89 

-0.15 

40779 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40779 

A 

1 

23 

42 

1.40 

0.26 

0.91 

0.45 

40779 

B 

0 

11 

20 

0.28 

0.25 

0.87 

-0.13 

40779 

C 

0 

13 

24 

-0.01 

0.23 

0.66 

-0.26 

40779 

D 

0 

8 

15 

0.12 

0.81 

1.78 

-0.16 

40780 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40780 

A 

1 

27 

49 

1.21 

0.15 

0.79 

0.46 

40780 

B 

0 

14 

25 

0.26 

0.32 

1.08 

-0.23 

40780 

C 

0 

7 

13 

-0.06 

0.24 

0.56 

-0.26 

40780 

D 

0 

7 

13 

0.33 

0.59 

2.02 

-0.13 

40781 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40781 

A 

1 

46 

84 

1.14 

0.16 

0.97 

0.34 

40781 

B 

0 

1 

2 

0.47 

0.00 

0.85 

-0.06 

40781 

C 

0 

4 

7 

-0.05 

0.37 

0.62 

-0.26 

40781 

D 

0 

4 

7 

0.24 

0.65 

1.14 

-0.19 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40782 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40782 

A 

1 

24 

43 

1.49 

0.22 

0.78 

0.56 

40782 

B 

0 

14 

25 

0.42 

0.21 

0.89 

-0.11 

40782 

C 

0 

8 

14 

0.22 

0.10 

0.60 

-0.14 

40782 

D 

0 

10 

18 

-0.65 

0.47 

0.44 

-0.48 

40783 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.03 

40783 

A 

1 

25 

42 

1.10 

0.26 

1.21 

0.34 

40783 

B 

0 

7 

12 

0.51 

0.27 

1.03 

-0.04 

40783 

C 

0 

20 

33 

0.28 

0.26 

1.12 

-0.21 

40783 

D 

0 

8 

13 

0.12 

0.25 

0.69 

-0.17 

40784 

* 

-1 

4598 

94 

0.98 

0.02 

0.00 

-0.07 

40784 

A 

1 

189 

66 

1.76 

0.07 

0.92 

0.51 

40784 

B 

0 

80 

28 

0.68 

0.09 

0.83 

-0.38 

40784 

C 

0 

11 

4 

0.35 

0.15 

0.49 

-0.18 

40784 

D 

0 

6 

2 

-0.41 

0.47 

0.33 

-0.23 

40785 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40785 

A 

1 

28 

51 

1.70 

0.19 

0.63 

0.66 

40785 

B 

0 

9 

16 

-0.39 

0.24 

0.36 

-0.46 

40785 

C 

0 

14 

25 

0.21 

0.25 

0.76 

-0.33 

40785 

D 

0 

4 

7 

0.63 

0.27 

0.87 

-0.06 

40786 

* 

-1 

4818 

99 

1.00 

0.02 

0.00 

0.04 

40786 

A 

1 

24 

36 

1.27 

0.28 

1.00 

0.43 

40786 

B 

0 

6 

9 

0.04 

0.39 

0.78 

-0.11 

40786 

C 

0 

24 

36 

0.09 

0.25 

1.13 

-0.24 

40786 

D 

0 

12 

18 

0.11 

0.31 

1.08 

-0.15 

40787 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40787 

A 

1 

46 

85 

1.02 

0.17 

0.87 

0.41 

40787 

B 

0 

2 

4 

-0.78 

0.28 

0.32 

-0.26 

40787 

C 

0 

4 

7 

-0.38 

0.43 

0.59 

-0.28 

40787 

D 

0 

2 

4 

0.12 

0.84 

1.03 

-0.11 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40788 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

40788 

A 

1 

36 

71 

1.31 

0.25 

0.89 

0.48 

40788 

B 

0 

4 

8 

0.69 

0.44 

1.81 

-0.03 

40788 

C 

0 

4 

8 

-0.59 

0.35 

0.45 

-0.28 

40788 

D 

0 

7 

14 

-0.62 

0.23 

0.42 

-0.39 

40789 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.02 

40789 

A 

1 

32 

63 

1.09 

0.19 

0.97 

0.42 

40789 

B 

0 

4 

8 

0.00 

0.87 

1.57 

-0.19 

40789 

C 

0 

3 

6 

0.64 

0.32 

1.20 

-0.02 

40789 

D 

0 

12 

24 

0.01 

0.21 

0.71 

-0.35 

40790 

* 

-1 

4813 

99 

1.00 

0.02 

0.00 

0.01 

40790 

A 

1 

56 

79 

1.13 

0.16 

1.02 

0.39 

40790 

B 

0 

6 

8 

0.15 

0.76 

2.53 

-0.17 

40790 

C 

0 

4 

6 

-0.57 

0.40 

0.45 

-0.27 

40790 

D 

0 

5 

7 

-0.02 

0.47 

0.91 

-0.19 

40791 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

-0.01 

40791 

A 

1 

42 

76 

1.39 

0.15 

0.97 

0.50 

40791 

B 

0 

7 

13 

-0.38 

0.28 

0.37 

-0.52 

40791 

C 

0 

1 

2 

0.61 

0.00 

0.80 

-0.06 

40791 

D 

0 

5 

9 

0.72 

0.29 

1.05 

-0.11 

40792 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40792 

A 

1 

34 

63 

1.02 

0.20 

0.87 

0.48 

40792 

B 

0 

6 

11 

-0.33 

0.24 

0.54 

-0.20 

40792 

C 

0 

9 

17 

0.07 

0.35 

1.27 

-0.13 

40792 

D 

0 

5 

9 

-1.36 

1.06 

0.68 

-0.41 

40793 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.02 

40793 

A 

1 

51 

81 

1.06 

0.15 

0.92 

0.47 

40793 

B 

0 

5 

8 

-0.15 

0.73 

1.20 

-0.18 

40793 

C 

0 

4 

6 

0.33 

0.47 

1.33 

-0.07 

40793 

D 

0 

3 

5 

-2.98 

1.28 

0.15 

-0.57 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40794 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.00 

40794 

A 

1 

41 

77 

1.12 

0.17 

1.07 

0.30 

40794 

B 

0 

2 

4 

0.55 

0.56 

1.02 

-0.08 

40794 

C 

0 

4 

8 

0.40 

0.66 

1.33 

-0.15 

40794 

D 

0 

6 

11 

0.31 

0.31 

0.93 

-0.22 

40795 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.00 

40795 

A 

1 

38 

76 

1.33 

0.18 

0.78 

0.56 

40795 

B 

0 

5 

10 

-0.20 

0.45 

0.58 

-0.32 

40795 

C 

0 

5 

10 

-0.10 

0.20 

0.51 

-0.29 

40795 

D 

0 

2 

4 

-0.83 

0.60 

0.27 

-0.30 

40796 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40796 

A 

1 

46 

85 

0.92 

0.19 

1.39 

0.26 

40796 

B 

0 

4 

7 

0.59 

0.55 

1.88 

-0.03 

40796 

C 

0 

2 

4 

0.74 

1.34 

2.88 

0.00 

40796 

D 

0 

2 

4 

-2.55 

2.42 

0.59 

-0.44 

40797 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40797 

A 

1 

43 

78 

0.94 

0.15 

1.14 

0.20 

40797 

B 

0 

1 

2 

0.32 

0.00 

0.75 

-0.07 

40797 

C 

0 

10 

18 

0.42 

0.35 

1.33 

-0.20 

40797 

D 

0 

1 

2 

0.96 

0.00 

1.42 

0.02 

40798 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

40798 

A 

1 

45 

79 

1.14 

0.15 

0.86 

0.52 

40798 

B 

0 

4 

7 

-0.48 

0.72 

0.61 

-0.32 

40798 

C 

0 

2 

4 

0.24 

0.04 

0.75 

-0.10 

40798 

D 

0 

6 

11 

-0.35 

0.27 

0.50 

-0.36 

40799 

* 

-1 

4825 

99 

1.01 

0.02 

0.00 

0.05 

40799 

A 

1 

50 

85 

0.51 

0.13 

0.96 

0.34 

40799 

B 

0 

5 

8 

-0.79 

0.43 

0.60 

-0.35 

40799 

C 

0 

2 

3 

-0.49 

0.06 

0.58 

-0.16 

40799 

D 

0 

2 

3 

0.54 

0.82 

2.18 

0.03 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40800 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.00 

40800 

A 

1 

39 

81 

1.38 

0.18 

0.87 

0.52 

40800 

B 

0 

3 

6 

-0.41 

1.07 

0.74 

-0.29 

40800 

C 

0 

3 

6 

-0.10 

0.54 

0.65 

-0.23 

40800 

D 

0 

3 

6 

-0.51 

0.84 

0.53 

-0.31 

40801 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40801 

A 

1 

22 

39 

1.59 

0.34 

1.15 

0.43 

40801 

B 

0 

16 

29 

0.61 

0.35 

2.50 

-0.04 

40801 

C 

0 

10 

18 

-0.06 

0.33 

0.57 

-0.22 

40801 

D 

0 

8 

14 

-0.53 

0.63 

0.61 

-0.31 

40802 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40802 

A 

1 

29 

52 

1.33 

0.21 

1.13 

0.39 

40802 

B 

0 

7 

13 

0.80 

0.36 

1.22 

-0.04 

40802 

C 

0 

12 

21 

0.11 

0.28 

0.68 

-0.37 

40802 

D 

0 

8 

14 

0.66 

0.32 

1.14 

-0.09 

40803 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

40803 

A 

1 

36 

65 

1.40 

0.20 

0.91 

0.46 

40803 

B 

0 

5 

9 

0.68 

0.37 

1.30 

-0.07 

40803 

C 

0 

7 

13 

0.26 

0.27 

0.74 

-0.21 

40803 

D 

0 

7 

13 

-0.26 

0.49 

0.57 

-0.37 

40804 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40804 

A 

1 

24 

44 

1.63 

0.28 

1.05 

0.53 

40804 

B 

0 

10 

19 

0.61 

0.26 

1.29 

-0.07 

40804 

C 

0 

12 

22 

-0.34 

0.27 

0.48 

-0.45 

40804 

D 

0 

8 

15 

0.33 

0.36 

0.91 

-0.14 

40805 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.01 

40805 

A 

1 

24 

41 

1.75 

0.29 

0.96 

0.55 

40805 

B 

0 

7 

12 

0.39 

0.42 

0.89 

-0.14 

40805 

C 

0 

18 

31 

0.32 

0.22 

0.86 

-0.28 

40805 

D 

0 

9 

16 

0.04 

0.23 

0.53 

-0.27 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40806 

* 

-1 

4834 

99 

0.99 

0.02 

0.00 

-0.02 

40806 

A 

1 

32 

64 

1.61 

0.18 

0.91 

0.38 

40806 

B 

0 

7 

14 

1.32 

0.53 

2.52 

0.01 

40806 

C 

0 

2 

4 

1.07 

1.50 

2.24 

-0.04 

40806 

D 

0 

9 

18 

0.15 

0.21 

0.45 

-0.46 

40807 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40807 

A 

1 

28 

49 

1.24 

0.24 

1.06 

0.50 

40807 

B 

0 

15 

26 

0.28 

0.21 

0.93 

-0.18 

40807 

C 

0 

2 

4 

0.00 

0.31 

0.58 

-0.10 

40807 

D 

0 

12 

21 

-0.23 

0.15 

0.50 

-0.38 

40808 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40808 

A 

1 

39 

70 

1.04 

0.17 

1.20 

0.43 

40808 

B 

0 

7 

13 

-0.27 

0.29 

0.58 

-0.35 

40808 

C 

0 

4 

7 

0.04 

0.47 

0.82 

-0.18 

40808 

D 

0 

6 

11 

0.36 

0.23 

0.94 

-0.12 

40809 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

40809 

A 

1 

30 

59 

1.49 

0.20 

0.85 

0.49 

40809 

B 

0 

13 

25 

0.35 

0.24 

0.82 

-0.23 

40809 

C 

0 

2 

4 

-0.15 

0.62 

0.44 

-0.15 

40809 

D 

0 

6 

12 

-0.50 

0.99 

0.90 

-0.36 

40810 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.03 

40810 

A 

1 

30 

48 

1.26 

0.26 

1.27 

0.43 

40810 

B 

0 

9 

15 

0.28 

0.36 

1.15 

-0.13 

40810 

C 

0 

4 

6 

0.02 

0.39 

0.68 

-0.13 

40810 

D 

0 

19 

31 

0.09 

0.21 

0.85 

-0.30 

40811 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40811 

A 

1 

8 

15 

1.68 

0.34 

0.86 

0.37 

40811 

B 

0 

19 

35 

0.41 

0.20 

0.71 

-0.24 

40811 

C 

0 

2 

4 

1.95 

0.23 

2.40 

0.22 

40811 

D 

0 

25 

46 

0.63 

0.22 

0.98 

-0.11 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40812 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40812 

A 

1 

15 

28 

1.83 

0.33 

1.36 

0.47 

40812 

B 

0 

17 

31 

0.70 

0.31 

2.02 

-0.05 

40812 

C 

0 

5 

9 

0.96 

0.24 

0.96 

0.04 

40812 

D 

0 

17 

31 

-0.04 

0.27 

0.57 

-0.42 

40813 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40813 

A 

1 

16 

29 

1.39 

0.37 

1.42 

0.44 

40813 

B 

0 

11 

20 

0.22 

0.28 

0.97 

-0.09 

40813 

C 

0 

9 

16 

-0.16 

0.53 

0.88 

-0.21 

40813 

D 

0 

19 

35 

0.14 

0.22 

0.82 

-0.18 

40814 

* 

-1 

4620 

95 

0.99 

0.02 

0.00 

-0.01 

40814 

A 

1 

76 

29 

1.75 

0.12 

0.96 

0.39 

40814 

B 

0 

35 

13 

0.31 

0.15 

0.56 

-0.27 

40814 

C 

0 

137 

52 

1.04 

0.07 

1.14 

-0.03 

40814 

D 

0 

16 

6 

-0.19 

0.45 

0.60 

-0.29 

40815 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

40815 

A 

1 

16 

32 

1.76 

0.38 

1.35 

0.43 

40815 

B 

0 

13 

26 

0.85 

0.27 

1.21 

0.01 

40815 

C 

0 

7 

14 

0.45 

0.37 

0.78 

-0.10 

40815 

D 

0 

14 

28 

-0.10 

0.42 

0.67 

-0.39 

40816 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40816 

A 

1 

25 

45 

1.16 

0.23 

1.04 

0.36 

40816 

B 

0 

5 

9 

0.52 

0.97 

3.46 

-0.01 

40816 

C 

0 

4 

7 

0.31 

0.38 

0.86 

-0.05 

40816 

D 

0 

21 

38 

-0.05 

0.35 

1.02 

-0.33 

40817 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40817 

A 

1 

8 

15 

1.74 

0.46 

1.16 

0.32 

40817 

B 

0 

7 

13 

0.73 

0.31 

0.83 

-0.01 

40817 

C 

0 

15 

29 

0.63 

0.24 

0.82 

-0.06 

40817 

D 

0 

22 

42 

0.50 

0.33 

0.88 

-0.17 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40818 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40818 

A 

1 

19 

37 

1.82 

0.35 

1.25 

0.47 

40818 

B 

0 

15 

29 

0.29 

0.28 

0.83 

-0.15 

40818 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40818 

D 

0 

18 

35 

-0.15 

0.48 

0.79 

-0.34 

40819 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.05 

40819 

A 

1 

7 

13 

0.50 

0.55 

3.40 

0.05 

40819 

B 

0 

7 

13 

0.68 

0.40 

1.44 

0.12 

40819 

C 

0 

21 

40 

0.61 

0.20 

1.30 

0.20 

40819 

D 

0 

18 

34 

-0.09 

0.19 

0.60 

-0.33 

40820 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.04 

40820 

A 

1 

42 

72 

0.74 

0.18 

1.32 

0.23 

40820 

B 

0 

1 

2 

-0.55 

0.00 

0.39 

-0.11 

40820 

C 

0 

3 

5 

0.33 

0.12 

0.95 

-0.04 

40820 

D 

0 

12 

21 

0.05 

0.53 

1.90 

-0.20 

40821 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40821 

A 

1 

15 

27 

0.53 

0.39 

2.89 

0.01 

40821 

B 

0 

11 

20 

0.50 

0.39 

1.14 

0.00 

40821 

C 

0 

12 

21 

0.72 

0.25 

1.24 

0.08 

40821 

D 

0 

18 

32 

0.36 

0.39 

1.23 

-0.08 

40822 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.05 

40822 

A 

1 

16 

29 

0.77 

0.34 

2.36 

0.14 

40822 

B 

0 

10 

18 

1.29 

0.26 

2.07 

0.25 

40822 

C 

0 

15 

27 

0.56 

0.17 

0.96 

0.05 

40822 

D 

0 

14 

25 

-0.75 

0.65 

1.77 

-0.42 

40823 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40823 

A 

1 

17 

29 

1.47 

0.22 

0.72 

0.50 

40823 

B 

0 

11 

19 

0.63 

0.31 

1.25 

0.00 

40823 

C 

0 

6 

10 

-0.10 

0.23 

0.46 

-0.23 

40823 

D 

0 

24 

41 

0.21 

0.21 

0.95 

-0.32 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40824 

* 

-1 

4628 

95 

0.97 

0.02 

0.00 

-0.08 

40824 

A 

1 

200 

78 

1.58 

0.08 

1.10 

0.25 

40824 

B 

0 

20 

8 

0.99 

0.21 

1.33 

-0.12 

40824 

C 

0 

30 

12 

0.86 

0.17 

1.13 

-0.19 

40824 

D 

0 

6 

2 

0.78 

0.24 

0.82 

-0.09 

40825 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

-0.01 

40825 

A 

1 

35 

66 

1.46 

0.21 

1.03 

0.40 

40825 

B 

0 

2 

4 

0.79 

0.87 

1.34 

-0.05 

40825 

C 

0 

8 

15 

0.57 

0.39 

1.30 

-0.18 

40825 

D 

0 

8 

15 

0.15 

0.30 

0.62 

-0.32 

40826 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.03 

40826 

A 

1 

42 

70 

1.00 

0.21 

1.18 

0.38 

40826 

B 

0 

4 

7 

0.04 

0.50 

0.99 

-0.09 

40826 

C 

0 

5 

8 

0.76 

0.71 

2.89 

0.03 

40826 

D 

0 

9 

15 

-1.12 

0.64 

0.60 

-0.45 

40827 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40827 

A 

1 

25 

45 

1.06 

0.27 

2.09 

0.33 

40827 

B 

0 

4 

7 

0.21 

0.14 

0.64 

-0.10 

40827 

C 

0 

9 

16 

0.41 

0.25 

0.95 

-0.09 

40827 

D 

0 

18 

32 

0.25 

0.24 

1.19 

-0.23 

40828 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

40828 

A 

1 

49 

84 

0.99 

0.21 

1.29 

0.28 

40828 

B 

0 

6 

10 

0.29 

0.77 

3.48 

-0.10 

40828 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40828 

D 

0 

3 

5 

-1.46 

1.79 

1.31 

-0.31 

40829 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40829 

A 

1 

46 

79 

0.78 

0.17 

0.94 

0.32 

40829 

B 

0 

4 

7 

0.26 

0.31 

1.12 

-0.08 

40829 

C 

0 

5 

9 

0.08 

0.51 

1.47 

-0.14 

40829 

D 

0 

3 

5 

-1.00 

0.46 

0.33 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40830 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

40830 

A 

1 

38 

76 

1.13 

0.19 

1.11 

0.27 

40830 

B 

0 

2 

4 

0.62 

0.76 

1.24 

-0.04 

40830 

C 

0 

5 

10 

1.68 

0.39 

3.74 

0.18 

40830 

D 

0 

5 

10 

-1.47 

0.94 

0.40 

-0.54 

40831 

* 

-1 

4827 

99 

1.01 

0.02 

0.00 

0.07 

40831 

A 

1 

28 

49 

1.07 

0.22 

0.70 

0.63 

40831 

B 

0 

3 

5 

-0.84 

0.45 

0.45 

-0.16 

40831 

C 

0 

11 

19 

-0.55 

0.21 

0.64 

-0.23 

40831 

D 

0 

15 

26 

-0.92 

0.36 

0.77 

-0.43 

40832 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.01 

40832 

A 

1 

34 

71 

1.30 

0.21 

0.96 

0.41 

40832 

B 

0 

3 

6 

-0.10 

0.77 

0.68 

-0.17 

40832 

C 

0 

4 

8 

1.03 

0.33 

1.62 

0.03 

40832 

D 

0 

7 

15 

-0.67 

0.79 

0.92 

-0.43 

40833 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.04 

40833 

A 

1 

54 

92 

0.72 

0.15 

0.91 

0.37 

40833 

B 

0 

1 

2 

-2.62 

0.00 

0.07 

-0.36 

40833 

C 

0 

1 

2 

-0.73 

0.00 

0.45 

-0.15 

40833 

D 

0 

3 

5 

-0.25 

0.39 

0.82 

-0.17 

40834 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40834 

A 

1 

40 

74 

0.88 

0.17 

0.86 

0.49 

40834 

B 

0 

7 

13 

-0.52 

0.32 

0.60 

-0.36 

40834 

C 

0 

3 

6 

-0.81 

0.87 

0.56 

-0.28 

40834 

D 

0 

4 

7 

0.05 

0.32 

0.92 

-0.12 

40835 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40835 

A 

1 

43 

78 

1.19 

0.18 

0.93 

0.52 

40835 

B 

0 

4 

7 

-0.41 

0.17 

0.41 

-0.23 

40835 

C 

0 

1 

2 

0.39 

0.00 

0.88 

-0.04 

40835 

D 

0 

7 

13 

-0.96 

0.79 

0.58 

-0.45 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40836 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40836 

A 

1 

36 

65 

1.23 

0.20 

0.93 

0.56 

40836 

B 

0 

4 

7 

-0.13 

0.27 

0.62 

-0.13 

40836 

C 

0 

5 

9 

-0.20 

0.30 

0.62 

-0.16 

40836 

D 

0 

10 

18 

-1.00 

0.64 

0.72 

-0.48 

40837 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.01 

40837 

A 

1 

48 

83 

1.25 

0.19 

0.78 

0.54 

40837 

B 

0 

5 

9 

-1.23 

0.24 

0.24 

-0.44 

40837 

C 

0 

3 

5 

-0.47 

0.78 

0.89 

-0.21 

40837 

D 

0 

2 

3 

-0.55 

0.07 

0.43 

-0.18 

40838 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

-0.02 

40838 

A 

1 

34 

60 

1.65 

0.22 

1.08 

0.46 

40838 

B 

0 

11 

19 

0.21 

0.16 

0.51 

-0.40 

40838 

C 

0 

10 

18 

0.92 

0.25 

1.19 

-0.10 

40838 

D 

0 

2 

4 

0.27 

1.03 

0.75 

-0.15 

40839 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40839 

A 

1 

22 

40 

1.59 

0.24 

0.70 

0.60 

40839 

B 

0 

7 

13 

0.05 

0.31 

0.67 

-0.23 

40839 

C 

0 

6 

11 

0.58 

0.26 

1.02 

-0.05 

40839 

D 

0 

20 

36 

0.10 

0.19 

0.79 

-0.42 

40840 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40840 

A 

1 

27 

47 

1.14 

0.22 

1.09 

0.37 

40840 

B 

0 

2 

4 

-0.90 

0.11 

0.20 

-0.27 

40840 

C 

0 

12 

21 

0.76 

0.25 

1.50 

0.03 

40840 

D 

0 

16 

28 

0.12 

0.26 

0.86 

-0.32 

40841 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40841 

A 

1 

42 

78 

1.17 

0.17 

0.78 

0.54 

40841 

B 

0 

3 

6 

0.14 

0.08 

0.75 

-0.13 

40841 

C 

0 

3 

6 

-0.47 

0.55 

0.56 

-0.25 

40841 

D 

0 

6 

11 

-0.77 

0.34 

0.38 

-0.45 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40842 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.04 

40842 

A 

1 

51 

86 

0.64 

0.12 

0.92 

0.30 

40842 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40842 

C 

0 

4 

7 

0.86 

0.29 

2.22 

0.09 

40842 

D 

0 

4 

7 

-1.31 

0.23 

0.24 

-0.51 

40843 

* 

-1 

4825 

99 

0.99 

0.02 

0.00 

-0.02 

40843 

A 

1 

53 

90 

1.42 

0.19 

0.94 

0.34 

40843 

B 

0 

1 

2 

0.06 

0.00 

0.57 

-0.11 

40843 

C 

0 

4 

7 

-0.70 

0.26 

0.30 

-0.37 

40843 

D 

0 

1 

2 

1.79 

0.00 

3.25 

0.05 

40844 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40844 

A 

1 

33 

61 

0.93 

0.17 

0.88 

0.48 

40844 

B 

0 

5 

9 

-0.23 

0.40 

0.70 

-0.22 

40844 

C 

0 

13 

24 

0.05 

0.26 

1.01 

-0.24 

40844 

D 

0 

3 

6 

-0.77 

0.50 

0.39 

-0.29 

40845 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.00 

40845 

A 

1 

48 

79 

1.30 

0.20 

0.95 

0.40 

40845 

B 

0 

5 

8 

0.06 

0.81 

1.55 

-0.19 

40845 

C 

0 

5 

8 

-0.12 

0.22 

0.57 

-0.23 

40845 

D 

0 

3 

5 

-0.36 

0.89 

0.69 

-0.21 

40846 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40846 

A 

1 

48 

87 

0.71 

0.14 

0.94 

0.37 

40846 

B 

0 

3 

5 

0.14 

0.21 

0.99 

-0.10 

40846 

C 

0 

1 

2 

-1.45 

0.00 

0.19 

-0.26 

40846 

D 

0 

3 

5 

-0.69 

0.71 

0.61 

-0.29 

40847 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.01 

40847 

A 

1 

51 

88 

1.09 

0.13 

0.92 

0.50 

40847 

B 

0 

3 

5 

-0.13 

0.20 

0.48 

-0.19 

40847 

C 

0 

1 

2 

0.90 

0.00 

1.29 

0.00 

40847 

D 

0 

3 

5 

-2.03 

1.52 

0.37 

-0.55 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40848 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40848 

A 

1 

47 

87 

0.99 

0.19 

1.00 

0.31 

40848 

B 

0 

1 

2 

-1.32 

0.00 

0.19 

-0.23 

40848 

C 

0 

5 

9 

0.27 

0.29 

1.12 

-0.14 

40848 

D 

0 

1 

2 

-1.29 

0.00 

0.20 

-0.23 

40849 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.00 

40849 

A 

1 

36 

75 

1.33 

0.24 

0.99 

0.46 

40849 

B 

0 

4 

8 

-0.32 

0.38 

0.54 

-0.26 

40849 

C 

0 

3 

6 

0.76 

0.15 

1.34 

-0.03 

40849 

D 

0 

5 

10 

-0.80 

0.47 

0.46 

-0.40 

40850 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40850 

A 

1 

51 

89 

0.84 

0.16 

1.34 

0.43 

40850 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40850 

C 

0 

1 

2 

-0.45 

0.00 

0.58 

-0.12 

40850 

D 

0 

5 

9 

-1.00 

0.52 

0.55 

-0.42 

40851 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40851 

A 

1 

40 

73 

1.24 

0.22 

0.85 

0.44 

40851 

B 

0 

10 

18 

0.03 

0.26 

0.90 

-0.28 

40851 

C 

0 

2 

4 

-0.07 

0.41 

0.66 

-0.13 

40851 

D 

0 

3 

5 

-0.73 

0.26 

0.34 

-0.28 

40852 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.03 

40852 

A 

1 

40 

66 

1.02 

0.17 

1.12 

0.47 

40852 

B 

0 

17 

28 

0.01 

0.26 

1.16 

-0.31 

40852 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40852 

D 

0 

4 

7 

-0.89 

0.67 

0.40 

-0.33 

40853 

* 

-1 

4829 

99 

1.01 

0.02 

0.00 

0.05 

40853 

A 

1 

15 

27 

1.25 

0.35 

1.10 

0.46 

40853 

B 

0 

9 

16 

0.03 

0.28 

0.76 

-0.12 

40853 

C 

0 

13 

24 

0.07 

0.29 

1.07 

-0.14 

40853 

D 

0 

18 

33 

0.00 

0.24 

1.07 

-0.21 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40854 

* 

-1 

4831 

99 

1.01 

0.02 

0.00 

0.07 

40854 

A 

1 

30 

57 

0.62 

0.17 

0.95 

0.40 

40854 

B 

0 

5 

9 

0.14 

0.22 

1.03 

-0.01 

40854 

C 

0 

6 

11 

-0.48 

0.23 

0.56 

-0.20 

40854 

D 

0 

12 

23 

-0.54 

0.53 

1.23 

-0.32 

40855 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.00 

40855 

A 

1 

33 

56 

1.53 

0.23 

0.93 

0.48 

40855 

B 

0 

17 

29 

0.38 

0.26 

1.04 

-0.27 

40855 

C 

0 

1 

2 

0.37 

0.00 

0.65 

-0.06 

40855 

D 

0 

8 

14 

-0.11 

0.28 

0.53 

-0.31 

40856 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40856 

A 

1 

20 

35 

0.72 

0.25 

1.90 

0.02 

40856 

B 

0 

7 

12 

0.41 

0.36 

0.92 

-0.12 

40856 

C 

0 

21 

37 

0.75 

0.14 

1.12 

0.05 

40856 

D 

0 

9 

16 

0.73 

0.39 

1.58 

0.01 

40857 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.03 

40857 

A 

1 

21 

34 

1.03 

0.34 

2.21 

0.22 

40857 

B 

0 

4 

7 

0.74 

0.87 

2.48 

0.02 

40857 

C 

0 

19 

31 

0.63 

0.17 

1.13 

-0.01 

40857 

D 

0 

17 

28 

0.15 

0.31 

1.16 

-0.24 

40858 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

-0.01 

40858 

A 

1 

9 

18 

2.17 

0.43 

0.97 

0.44 

40858 

B 

0 

10 

20 

0.86 

0.36 

0.88 

-0.10 

40858 

C 

0 

15 

29 

1.26 

0.25 

1.26 

0.10 

40858 

D 

0 

17 

33 

0.49 

0.21 

0.54 

-0.37 

40859 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

40859 

A 

1 

28 

49 

1.52 

0.23 

0.93 

0.49 

40859 

B 

0 

5 

9 

-0.48 

0.42 

0.37 

-0.38 

40859 

C 

0 

8 

14 

0.53 

0.25 

0.87 

-0.14 

40859 

D 

0 

16 

28 

0.55 

0.19 

0.93 

-0.20 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40860 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40860 

A 

1 

43 

78 

0.86 

0.18 

1.09 

0.24 

40860 

B 

0 

5 

9 

0.94 

0.71 

6.37 

0.06 

40860 

C 

0 

1 

2 

2.26 

0.00 

7.25 

0.16 

40860 

D 

0 

6 

11 

-0.99 

0.47 

0.39 

-0.44 

40861 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

-0.01 

40861 

A 

1 

29 

54 

1.95 

0.26 

0.79 

0.61 

40861 

B 

0 

7 

13 

0.29 

0.40 

1.04 

-0.20 

40861 

C 

0 

15 

28 

0.01 

0.29 

0.79 

-0.44 

40861 

D 

0 

3 

6 

0.07 

0.44 

0.55 

-0.16 

40862 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.02 

40862 

A 

1 

41 

80 

1.06 

0.18 

0.73 

0.57 

40862 

B 

0 

3 

6 

-1.14 

0.73 

0.43 

-0.34 

40862 

C 

0 

3 

6 

-1.19 

0.40 

0.28 

-0.35 

40862 

D 

0 

4 

8 

-0.39 

0.46 

0.70 

-0.24 

40863 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.03 

40863 

A 

1 

40 

82 

0.83 

0.21 

1.23 

0.30 

40863 

B 

0 

3 

6 

-0.98 

0.73 

0.57 

-0.31 

40863 

C 

0 

5 

10 

0.35 

0.60 

2.41 

-0.07 

40863 

D 

0 

1 

2 

-0.74 

0.00 

0.42 

-0.15 

40864 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40864 

A 

1 

38 

70 

1.06 

0.21 

1.10 

0.38 

40864 

B 

0 

1 

2 

-0.58 

0.00 

0.36 

-0.15 

40864 

C 

0 

6 

11 

0.12 

0.22 

0.82 

-0.18 

40864 

D 

0 

9 

17 

0.03 

0.30 

0.88 

-0.26 

40865 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40865 

A 

1 

38 

70 

1.28 

0.22 

1.13 

0.39 

40865 

B 

0 

6 

11 

0.36 

0.23 

0.87 

-0.15 

40865 

C 

0 

5 

9 

0.25 

0.48 

1.07 

-0.16 

40865 

D 

0 

5 

9 

-0.31 

0.75 

0.86 

-0.29 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40866 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.02 

40866 

A 

1 

38 

64 

1.06 

0.14 

0.91 

0.50 

40866 

B 

0 

5 

8 

-0.16 

0.31 

0.55 

-0.29 

40866 

C 

0 

8 

14 

0.33 

0.12 

0.79 

-0.17 

40866 

D 

0 

8 

14 

0.01 

0.31 

0.74 

-0.30 

40867 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.04 

40867 

A 

1 

23 

40 

1.41 

0.22 

0.79 

0.50 

40867 

B 

0 

8 

14 

-0.05 

0.42 

0.66 

-0.18 

40867 

C 

0 

20 

35 

0.36 

0.18 

1.08 

-0.11 

40867 

D 

0 

6 

11 

-1.17 

0.88 

0.39 

-0.43 

40868 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.01 

40868 

A 

1 

47 

96 

0.96 

0.18 

0.93 

0.32 

40868 

B 

0 

1 

2 

-1.65 

0.00 

0.15 

-0.28 

40868 

C 

0 

1 

2 

-0.54 

0.00 

0.46 

-0.16 

40868 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40869 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40869 

A 

1 

20 

35 

1.38 

0.43 

2.10 

0.30 

40869 

B 

0 

16 

28 

0.60 

0.28 

1.56 

-0.08 

40869 

C 

0 

14 

25 

0.70 

0.22 

1.30 

-0.03 

40869 

D 

0 

7 

12 

-0.30 

0.32 

0.42 

-0.28 

40870 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

-0.01 

40870 

A 

1 

57 

98 

1.12 

0.16 

1.03 

-0.01 

40870 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40870 

C 

0 

1 

2 

1.18 

0.00 

1.79 

0.01 

40870 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40871 

* 

-1 

4838 

99 

1.00 

0.02 

0.00 

-0.02 

40871 

A 

1 

38 

83 

1.51 

0.17 

0.80 

0.47 

40871 

B 

0 

1 

2 

-0.39 

0.00 

0.29 

-0.20 

40871 

C 

0 

3 

7 

0.44 

0.90 

1.16 

-0.18 

40871 

D 

0 

4 

9 

-0.21 

0.70 

0.69 

-0.37 
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Item  ID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40872 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

-0.01 

40872 

A 

1 

44 

94 

1.25 

0.23 

0.97 

0.29 

40872 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40872 

C 

0 

2 

4 

-0.95 

0.16 

0.27 

-0.29 

40872 

D 

0 

1 

2 

0.24 

0.00 

0.88 

-0.09 

40873 

* 

-1 

4840 

99 

1.00 

0.02 

0.00 

0.00 

40873 

A 

1 

40 

91 

1.06 

0.17 

1.07 

0.15 

40873 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40873 

C 

0 

4 

9 

0.48 

0.48 

1.23 

-0.15 

40873 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40874 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

40874 

A 

1 

37 

65 

1.23 

0.24 

0.89 

0.41 

40874 

B 

0 

4 

7 

0.68 

0.19 

1.31 

-0.01 

40874 

C 

0 

6 

11 

-0.11 

0.31 

0.70 

-0.20 

40874 

D 

0 

10 

18 

-0.39 

0.55 

1.08 

-0.35 

40875 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40875 

A 

1 

47 

84 

1.20 

0.22 

0.89 

0.55 

40875 

B 

0 

3 

5 

-0.86 

0.97 

0.84 

-0.21 

40875 

C 

0 

3 

5 

-1.51 

0.14 

0.20 

-0.30 

40875 

D 

0 

3 

5 

-2.16 

1.61 

0.53 

-0.38 

40876 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

40876 

A 

1 

48 

94 

0.94 

0.19 

1.01 

0.18 

40876 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40876 

C 

0 

2 

4 

0.24 

0.63 

1.11 

-0.10 

40876 

D 

0 

1 

2 

-0.67 

0.00 

0.37 

-0.17 

40877 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

-0.01 

40877 

A 

-1 

58 

100 

1.07 

0.17 

0.00 

0.00 

40877 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40877 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

40877 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


373 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40878 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40878 

A 

1 

40 

74 

1.18 

0.18 

0.85 

0.57 

40878 

B 

0 

2 

4 

0.55 

0.25 

1.14 

-0.01 

40878 

C 

0 

4 

7 

-0.65 

0.61 

0.54 

-0.23 

40878 

D 

0 

8 

15 

-1.33 

0.73 

0.52 

-0.52 

40879 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40879 

A 

1 

37 

66 

1.08 

0.18 

0.92 

0.46 

40879 

B 

0 

7 

13 

0.36 

0.46 

1.68 

-0.11 

40879 

C 

0 

4 

7 

-0.65 

0.50 

0.49 

-0.31 

40879 

D 

0 

8 

14 

-0.15 

0.35 

0.81 

-0.29 

40880 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40880 

A 

1 

42 

76 

0.95 

0.17 

0.97 

0.35 

40880 

B 

0 

3 

5 

-0.21 

0.85 

1.07 

-0.20 

40880 

C 

0 

5 

9 

0.29 

0.23 

0.94 

-0.12 

40880 

D 

0 

5 

9 

-0.14 

0.62 

0.98 

-0.24 

40881 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.03 

40881 

A 

1 

41 

66 

1.28 

0.20 

0.83 

0.57 

40881 

B 

0 

11 

18 

-0.54 

0.36 

0.74 

-0.36 

40881 

C 

0 

4 

6 

0.16 

0.53 

1.29 

-0.08 

40881 

D 

0 

6 

10 

-1.07 

0.65 

0.52 

-0.37 

40882 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.01 

40882 

A 

1 

28 

54 

1.38 

0.20 

0.86 

0.49 

40882 

B 

0 

6 

12 

-0.02 

0.81 

1.54 

-0.25 

40882 

C 

0 

5 

10 

0.24 

0.26 

0.70 

-0.15 

40882 

D 

0 

13 

25 

0.24 

0.23 

0.83 

-0.27 

40883 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40883 

A 

1 

19 

34 

1.57 

0.23 

0.84 

0.43 

40883 

B 

0 

4 

7 

0.57 

0.53 

0.91 

-0.09 

40883 

C 

0 

8 

14 

0.65 

0.33 

1.00 

-0.10 

40883 

D 

0 

25 

45 

0.55 

0.21 

0.92 

-0.30 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40884 

* 

-1 

4841 

99 

1.00 

0.02 

0.00 

0.01 

40884 

A 

1 

26 

60 

1.28 

0.25 

1.16 

0.43 

40884 

B 

0 

6 

14 

0.08 

0.47 

1.00 

-0.25 

40884 

C 

0 

2 

5 

0.54 

0.62 

1.03 

-0.06 

40884 

D 

0 

9 

21 

0.19 

0.24 

0.76 

-0.27 

40885 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

40885 

A 

1 

21 

40 

1.65 

0.31 

1.04 

0.51 

40885 

B 

0 

15 

28 

0.40 

0.21 

0.90 

-0.13 

40885 

C 

0 

3 

6 

-0.14 

0.63 

0.58 

-0.14 

40885 

D 

0 

14 

26 

-0.18 

0.42 

0.71 

-0.36 

40886 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40886 

A 

1 

35 

64 

1.28 

0.17 

0.84 

0.54 

40886 

B 

0 

6 

11 

0.30 

0.26 

0.81 

-0.17 

40886 

C 

0 

3 

5 

0.90 

0.36 

1.41 

0.01 

40886 

D 

0 

11 

20 

-0.31 

0.22 

0.49 

-0.53 

40887 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

-0.01 

40887 

A 

1 

56 

97 

1.11 

0.15 

1.06 

0.14 

40887 

B 

0 

1 

2 

0.20 

0.00 

0.71 

-0.11 

40887 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40887 

D 

0 

1 

2 

0.37 

0.00 

0.83 

-0.09 

40888 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.05 

40888 

A 

1 

41 

76 

0.69 

0.20 

0.96 

0.35 

40888 

B 

0 

7 

13 

-0.15 

0.66 

2.49 

-0.16 

40888 

C 

0 

3 

6 

-1.37 

0.79 

0.41 

-0.31 

40888 

D 

0 

3 

6 

-0.30 

0.43 

0.87 

-0.12 

40889 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.04 

40889 

A 

1 

49 

82 

0.82 

0.18 

0.97 

0.38 

40889 

B 

0 

1 

2 

-1.20 

0.00 

0.26 

-0.18 

40889 

C 

0 

3 

5 

-0.57 

0.39 

0.56 

-0.20 

40889 

D 

0 

7 

12 

-0.31 

0.43 

1.01 

-0.25 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40890 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40890 

A 

1 

42 

76 

1.15 

0.14 

0.86 

0.50 

40890 

B 

0 

7 

13 

-0.05 

0.53 

0.91 

-0.32 

40890 

C 

0 

4 

7 

0.14 

0.19 

0.65 

-0.19 

40890 

D 

0 

2 

4 

-0.81 

0.43 

0.26 

-0.30 

40891 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40891 

A 

1 

43 

78 

1.10 

0.15 

0.76 

0.59 

40891 

B 

0 

3 

5 

0.31 

0.66 

1.28 

-0.04 

40891 

C 

0 

6 

11 

-0.35 

0.25 

0.55 

-0.21 

40891 

D 

0 

3 

5 

-4.41 

0.85 

0.02 

-0.75 

40892 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40892 

A 

1 

19 

35 

1.11 

0.26 

1.41 

0.28 

40892 

B 

0 

25 

46 

0.74 

0.20 

1.33 

0.02 

40892 

C 

0 

3 

6 

-0.43 

0.39 

0.32 

-0.26 

40892 

D 

0 

7 

13 

0.02 

0.33 

0.60 

-0.25 

40893 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

-0.01 

40893 

A 

1 

48 

98 

1.10 

0.20 

1.01 

0.16 

40893 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40893 

C 

0 

1 

2 

-0.39 

0.00 

0.47 

-0.16 

40893 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40894 

* 

-1 

4823 

99 

1.01 

0.02 

0.00 

0.05 

40894 

A 

1 

50 

82 

0.74 

0.16 

0.81 

0.47 

40894 

B 

0 

6 

10 

-0.79 

0.63 

0.88 

-0.29 

40894 

C 

0 

4 

7 

-0.43 

0.37 

0.78 

-0.17 

40894 

D 

0 

1 

2 

-4.05 

0.00 

0.02 

-0.42 

40895 

* 

-1 

4829 

99 

1.01 

0.02 

0.00 

0.06 

40895 

A 

1 

50 

91 

0.49 

0.17 

0.93 

0.52 

40895 

B 

0 

3 

5 

-1.28 

0.50 

0.47 

-0.25 

40895 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40895 

D 

0 

2 

4 

-3.47 

1.89 

0.27 

-0.49 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40896 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.00 

40896 

A 

1 

44 

85 

1.23 

0.15 

0.84 

0.45 

40896 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40896 

C 

0 

6 

12 

-0.08 

0.50 

0.92 

-0.35 

40896 

D 

0 

2 

4 

-0.45 

0.07 

0.34 

-0.26 

40897 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

40897 

A 

1 

40 

75 

0.93 

0.20 

1.16 

0.19 

40897 

B 

0 

10 

19 

0.46 

0.24 

1.19 

-0.14 

40897 

C 

0 

3 

6 

0.31 

0.71 

1.23 

-0.10 

40897 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40898 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.03 

40898 

A 

1 

44 

86 

0.86 

0.16 

0.92 

0.46 

40898 

B 

0 

6 

12 

-0.75 

0.41 

0.59 

-0.45 

40898 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40898 

D 

0 

1 

2 

-0.19 

0.00 

0.66 

-0.10 

40899 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40899 

A 

1 

46 

84 

1.15 

0.23 

1.07 

0.41 

40899 

B 

0 

2 

4 

0.49 

0.25 

1.27 

-0.04 

40899 

C 

0 

5 

9 

-0.43 

0.39 

0.66 

-0.23 

40899 

D 

0 

2 

4 

-2.86 

2.50 

0.52 

-0.42 

40900 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

40900 

A 

1 

46 

92 

0.98 

0.16 

0.93 

0.39 

40900 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40900 

C 

0 

3 

6 

-0.61 

0.15 

0.37 

-0.34 

40900 

D 

0 

1 

2 

-0.57 

0.00 

0.38 

-0.19 

40901 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.01 

40901 

A 

1 

17 

32 

1.32 

0.25 

1.14 

0.29 

40901 

B 

0 

10 

19 

0.94 

0.28 

1.33 

0.03 

40901 

C 

0 

12 

23 

0.78 

0.34 

1.56 

-0.05 

40901 

D 

0 

14 

26 

0.34 

0.28 

0.89 

-0.30 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40902 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

40902 

A 

1 

13 

23 

1.19 

0.37 

1.89 

0.13 

40902 

B 

0 

8 

14 

0.66 

0.29 

0.74 

-0.08 

40902 

C 

0 

10 

18 

0.96 

0.58 

4.09 

0.02 

40902 

D 

0 

25 

45 

0.79 

0.23 

1.07 

-0.07 

40903 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40903 

A 

1 

49 

91 

0.96 

0.16 

0.85 

0.53 

40903 

B 

0 

2 

4 

0.01 

0.14 

0.77 

-0.09 

40903 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40903 

D 

0 

3 

6 

-2.91 

1.48 

0.28 

-0.60 

40904 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

40904 

A 

1 

50 

88 

1.04 

0.16 

0.96 

0.36 

40904 

B 

0 

2 

4 

-0.22 

0.64 

0.60 

-0.19 

40904 

C 

0 

3 

5 

-0.06 

0.47 

0.71 

-0.20 

40904 

D 

0 

2 

4 

-0.42 

0.74 

0.52 

-0.22 

40905 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40905 

A 

1 

44 

80 

1.13 

0.15 

0.81 

0.61 

40905 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40905 

C 

0 

5 

9 

-0.41 

0.38 

0.59 

-0.33 

40905 

D 

0 

6 

11 

-0.79 

0.14 

0.31 

-0.48 

40906 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.05 

40906 

A 

1 

42 

76 

0.81 

0.16 

0.93 

0.51 

40906 

B 

0 

5 

9 

-0.29 

0.16 

0.60 

-0.19 

40906 

C 

0 

3 

5 

0.26 

0.57 

1.32 

-0.04 

40906 

D 

0 

5 

9 

-1.69 

0.75 

0.33 

-0.54 

40907 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.00 

40907 

A 

1 

16 

30 

1.20 

0.30 

1.66 

0.13 

40907 

B 

0 

8 

15 

1.13 

0.53 

2.34 

0.06 

40907 

C 

0 

29 

55 

0.82 

0.19 

1.38 

-0.16 

40907 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40908 

* 

-1 

4829 

99 

1.01 

0.02 

0.00 

0.06 

40908 

A 

1 

36 

65 

0.57 

0.23 

1.41 

0.29 

40908 

B 

0 

1 

2 

0.58 

0.00 

1.47 

0.03 

40908 

C 

0 

14 

25 

0.23 

0.25 

1.49 

0.00 

40908 

D 

0 

4 

7 

-3.02 

1.48 

0.52 

-0.55 

40909 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40909 

A 

1 

24 

44 

1.10 

0.23 

1.24 

0.31 

40909 

B 

0 

20 

36 

0.83 

0.27 

2.60 

0.10 

40909 

C 

0 

11 

20 

-0.59 

0.21 

0.34 

-0.51 

40909 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40910 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40910 

A 

1 

34 

61 

1.01 

0.19 

1.80 

0.36 

40910 

B 

0 

8 

14 

0.21 

0.33 

0.99 

-0.17 

40910 

C 

0 

4 

7 

0.17 

0.37 

0.80 

-0.12 

40910 

D 

0 

10 

18 

0.12 

0.37 

1.02 

-0.23 

40911 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.02 

40911 

A 

1 

16 

26 

1.24 

0.36 

1.87 

0.26 

40911 

B 

0 

4 

7 

0.87 

0.28 

1.02 

0.03 

40911 

C 

0 

23 

38 

0.62 

0.21 

1.14 

-0.09 

40911 

D 

0 

18 

30 

0.46 

0.23 

0.85 

-0.17 

40912 

* 

-1 

4623 

95 

0.98 

0.02 

0.00 

-0.06 

40912 

A 

1 

239 

92 

1.43 

0.07 

0.90 

0.38 

40912 

B 

0 

5 

2 

0.59 

0.58 

1.32 

-0.09 

40912 

C 

0 

5 

2 

0.18 

0.57 

0.86 

-0.14 

40912 

D 

0 

12 

5 

-0.46 

0.19 

0.33 

-0.36 

40913 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

-0.01 

40913 

A 

1 

37 

79 

1.45 

0.17 

0.85 

0.51 

40913 

B 

0 

1 

2 

0.24 

0.00 

0.54 

-0.12 

40913 

C 

0 

3 

6 

-0.07 

0.22 

0.41 

-0.29 

40913 

D 

0 

6 

13 

0.10 

0.38 

0.61 

-0.37 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40914 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

-0.02 

40914 

A 

1 

49 

91 

1.36 

0.15 

0.84 

0.41 

40914 

B 

0 

4 

7 

-0.19 

0.78 

1.06 

-0.34 

40914 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40914 

D 

0 

1 

2 

-0.60 

0.00 

0.27 

-0.21 

40915 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

40915 

A 

1 

49 

84 

1.01 

0.19 

0.80 

0.47 

40915 

B 

0 

7 

12 

-0.87 

0.38 

0.50 

-0.43 

40915 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40915 

D 

0 

2 

3 

-0.54 

0.73 

0.62 

-0.17 

40916 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.05 

40916 

A 

1 

46 

84 

0.74 

0.17 

0.74 

0.52 

40916 

B 

0 

4 

7 

-0.46 

0.51 

0.92 

-0.19 

40916 

C 

0 

2 

4 

-1.53 

0.98 

0.34 

-0.28 

40916 

D 

0 

3 

5 

-1.78 

1.12 

0.55 

-0.40 

40917 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.01 

40917 

A 

1 

20 

32 

1.50 

0.23 

1.08 

0.37 

40917 

B 

0 

4 

6 

0.68 

0.15 

0.69 

-0.05 

40917 

C 

0 

25 

40 

0.81 

0.23 

1.34 

-0.06 

40917 

D 

0 

13 

21 

0.20 

0.27 

0.61 

-0.32 

40918 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.01 

40918 

A 

1 

20 

42 

1.28 

0.29 

1.43 

0.28 

40918 

B 

0 

5 

10 

1.40 

0.43 

2.14 

0.15 

40918 

C 

0 

4 

8 

0.92 

0.17 

0.99 

0.00 

40918 

D 

0 

19 

40 

0.39 

0.22 

0.87 

-0.38 

40919 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

40919 

A 

1 

52 

96 

0.66 

0.12 

0.99 

0.23 

40919 

B 

0 

2 

4 

-0.36 

0.60 

0.62 

-0.23 

40919 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40919 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40920 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

40920 

A 

1 

53 

93 

0.84 

0.18 

0.97 

0.39 

40920 

B 

0 

1 

2 

-0.13 

0.00 

0.71 

-0.07 

40920 

C 

0 

2 

4 

-0.25 

1.43 

1.40 

-0.11 

40920 

D 

0 

1 

2 

-5.36 

0.00 

0.00 

-0.53 

40921 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

40921 

A 

1 

46 

87 

0.94 

0.20 

0.94 

0.36 

40921 

B 

0 

4 

8 

-0.31 

0.52 

0.87 

-0.22 

40921 

C 

0 

3 

6 

-0.76 

0.49 

0.50 

-0.27 

40921 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40922 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40922 

A 

1 

45 

83 

0.99 

0.17 

0.90 

0.44 

40922 

B 

0 

5 

9 

-0.92 

0.14 

0.30 

-0.44 

40922 

C 

0 

4 

7 

0.16 

0.65 

1.37 

-0.14 

40922 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40923 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40923 

A 

1 

44 

81 

1.15 

0.16 

0.82 

0.55 

40923 

B 

0 

5 

9 

-0.32 

0.43 

0.63 

-0.26 

40923 

C 

0 

2 

4 

-0.36 

1.04 

0.67 

-0.16 

40923 

D 

0 

3 

6 

-1.83 

1.37 

0.41 

-0.47 

40924 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.00 

40924 

A 

1 

43 

80 

1.38 

0.17 

0.90 

0.54 

40924 

B 

0 

6 

11 

-0.27 

0.34 

0.50 

-0.30 

40924 

C 

0 

1 

2 

0.05 

0.00 

0.54 

-0.09 

40924 

D 

0 

4 

7 

-1.27 

1.32 

0.67 

-0.43 

40925 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.00 

40925 

A 

1 

43 

77 

1.16 

0.22 

2.06 

0.27 

40925 

B 

0 

1 

2 

0.02 

0.00 

0.57 

-0.09 

40925 

C 

0 

12 

21 

0.32 

0.23 

1.07 

-0.25 

40925 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40926 

* 

-1 

4618 

95 

0.98 

0.02 

0.00 

-0.07 

40926 

A 

1 

211 

79 

1.64 

0.07 

0.96 

0.45 

40926 

B 

0 

13 

5 

-0.44 

0.35 

0.43 

-0.36 

40926 

C 

0 

38 

14 

0.66 

0.16 

1.05 

-0.26 

40926 

D 

0 

4 

2 

0.16 

0.37 

0.48 

-0.13 

40927 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.02 

40927 

A 

1 

30 

63 

1.33 

0.26 

0.87 

0.50 

40927 

B 

0 

1 

2 

0.38 

0.00 

0.89 

-0.03 

40927 

C 

0 

11 

23 

-0.05 

0.19 

0.71 

-0.25 

40927 

D 

0 

6 

13 

-1.04 

1.00 

0.96 

-0.40 

40928 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40928 

A 

1 

19 

35 

0.88 

0.32 

2.13 

0.09 

40928 

B 

0 

8 

15 

0.74 

0.41 

1.42 

0.00 

40928 

C 

0 

21 

39 

0.64 

0.20 

1.13 

-0.07 

40928 

D 

0 

6 

11 

0.60 

0.50 

1.58 

-0.04 

40929 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40929 

A 

1 

11 

19 

0.98 

0.31 

1.67 

0.15 

40929 

B 

0 

18 

31 

0.29 

0.29 

0.90 

-0.17 

40929 

C 

0 

15 

26 

0.67 

0.38 

2.81 

0.03 

40929 

D 

0 

14 

24 

0.63 

0.30 

1.14 

0.01 

40930 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

0.04 

40930 

A 

1 

26 

55 

1.12 

0.22 

0.97 

0.45 

40930 

B 

0 

6 

13 

1.14 

0.36 

2.49 

0.16 

40930 

C 

0 

3 

6 

-0.82 

0.12 

0.26 

-0.24 

40930 

D 

0 

12 

26 

-0.74 

0.49 

0.65 

-0.50 

40931 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.00 

40931 

A 

1 

12 

24 

2.15 

0.52 

1.56 

0.46 

40931 

B 

0 

7 

14 

0.16 

0.15 

0.38 

-0.22 

40931 

C 

0 

20 

40 

1.02 

0.18 

1.13 

0.04 

40931 

D 

0 

11 

22 

0.04 

0.51 

0.75 

-0.33 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40932 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40932 

A 

1 

14 

25 

1.00 

0.40 

1.63 

0.27 

40932 

B 

0 

21 

38 

0.28 

0.15 

0.84 

-0.17 

40932 

C 

0 

7 

13 

0.02 

0.36 

0.71 

-0.17 

40932 

D 

0 

13 

24 

0.61 

0.30 

1.52 

0.05 

40933 

* 

-1 

4641 

95 

0.98 

0.02 

0.00 

-0.07 

40933 

A 

1 

235 

97 

1.49 

0.07 

0.86 

0.36 

40933 

B 

0 

6 

2 

-0.61 

0.44 

0.34 

-0.29 

40933 

C 

0 

1 

0 

0.62 

0.00 

0.79 

-0.05 

40933 

D 

0 

1 

0 

-2.75 

0.00 

0.03 

-0.24 

40934 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

40934 

A 

1 

31 

53 

1.04 

0.22 

1.64 

0.30 

40934 

B 

0 

4 

7 

-0.39 

0.57 

0.50 

-0.17 

40934 

C 

0 

15 

26 

0.87 

0.29 

2.28 

0.10 

40934 

D 

0 

8 

14 

-1.12 

0.84 

0.82 

-0.44 

40935 

* 

-1 

4820 

99 

1.00 

0.02 

0.00 

0.02 

40935 

A 

1 

45 

70 

1.28 

0.15 

0.78 

0.57 

40935 

B 

0 

9 

14 

-0.16 

0.47 

1.07 

-0.26 

40935 

C 

0 

6 

9 

-0.07 

0.37 

0.71 

-0.19 

40935 

D 

0 

4 

6 

-1.85 

1.20 

0.38 

-0.47 

40936 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40936 

A 

1 

39 

75 

0.94 

0.19 

1.58 

0.37 

40936 

B 

0 

7 

13 

0.27 

0.29 

1.11 

-0.15 

40936 

C 

0 

2 

4 

-0.53 

0.56 

0.44 

-0.22 

40936 

D 

0 

4 

8 

-0.34 

0.08 

0.46 

-0.26 

40937 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.03 

40937 

A 

1 

23 

46 

1.32 

0.15 

0.78 

0.48 

40937 

B 

0 

6 

12 

-0.56 

0.35 

0.35 

-0.36 

40937 

C 

0 

14 

28 

0.77 

0.30 

1.63 

0.05 

40937 

D 

0 

7 

14 

-0.67 

0.64 

0.44 

-0.43 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40938 

* 

-1 

4597 

94 

0.97 

0.02 

0.00 

-0.10 

40938 

A 

1 

202 

70 

1.88 

0.08 

0.96 

0.49 

40938 

B 

0 

38 

13 

0.55 

0.13 

0.70 

-0.30 

40938 

C 

0 

40 

14 

0.71 

0.14 

0.96 

-0.26 

40938 

D 

0 

7 

2 

-0.13 

0.40 

0.37 

-0.21 

40939 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.01 

40939 

A 

1 

24 

46 

1.56 

0.25 

1.02 

0.52 

40939 

B 

0 

9 

17 

0.21 

0.21 

0.66 

-0.24 

40939 

C 

0 

14 

27 

0.34 

0.32 

1.28 

-0.25 

40939 

D 

0 

5 

10 

0.08 

0.38 

0.60 

-0.20 

40940 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.05 

40940 

A 

1 

28 

49 

0.77 

0.20 

1.15 

0.35 

40940 

B 

0 

20 

35 

0.06 

0.17 

0.94 

-0.29 

40940 

C 

0 

3 

5 

0.17 

0.28 

0.84 

-0.07 

40940 

D 

0 

6 

11 

0.25 

0.25 

1.04 

-0.07 

40941 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40941 

A 

1 

48 

87 

0.66 

0.18 

1.35 

0.22 

40941 

B 

0 

4 

7 

0.28 

0.32 

1.35 

-0.06 

40941 

C 

0 

2 

4 

-0.71 

0.85 

0.62 

-0.20 

40941 

D 

0 

1 

2 

-0.65 

0.00 

0.48 

-0.13 

40942 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.01 

40942 

A 

1 

16 

33 

1.95 

0.31 

0.66 

0.58 

40942 

B 

0 

5 

10 

0.39 

0.48 

0.90 

-0.13 

40942 

C 

0 

16 

33 

0.63 

0.13 

0.86 

-0.14 

40942 

D 

0 

12 

24 

0.01 

0.37 

0.80 

-0.39 

40943 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.01 

40943 

A 

1 

37 

64 

1.36 

0.19 

0.92 

0.57 

40943 

B 

0 

11 

19 

-0.44 

0.21 

0.43 

-0.50 

40943 

C 

0 

4 

7 

0.64 

0.25 

1.14 

-0.04 

40943 

D 

0 

6 

10 

0.02 

0.38 

0.78 

-0.22 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40944 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.01 

40944 

A 

1 

9 

18 

1.04 

0.36 

2.17 

0.06 

40944 

B 

0 

18 

36 

0.33 

0.29 

0.66 

-0.31 

40944 

C 

0 

14 

28 

1.56 

0.36 

2.79 

0.32 

40944 

D 

0 

9 

18 

0.75 

0.46 

1.09 

-0.05 

40945 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.03 

40945 

A 

1 

35 

69 

1.19 

0.20 

0.83 

0.57 

40945 

B 

0 

8 

16 

-0.23 

0.28 

0.69 

-0.29 

40945 

C 

0 

3 

6 

0.47 

0.29 

1.17 

-0.04 

40945 

D 

0 

5 

10 

-1.32 

0.39 

0.24 

-0.50 

40946 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.01 

40946 

A 

1 

23 

37 

1.52 

0.23 

0.97 

0.45 

40946 

B 

0 

17 

27 

0.78 

0.24 

1.26 

-0.03 

40946 

C 

0 

7 

11 

-0.02 

0.53 

0.67 

-0.27 

40946 

D 

0 

15 

24 

0.27 

0.19 

0.66 

-0.28 

40947 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40947 

A 

1 

25 

45 

1.15 

0.31 

1.30 

0.40 

40947 

B 

0 

4 

7 

0.56 

0.33 

1.24 

0.00 

40947 

C 

0 

12 

21 

0.14 

0.21 

0.88 

-0.16 

40947 

D 

0 

15 

27 

-0.12 

0.28 

0.89 

-0.30 

40948 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40948 

A 

1 

13 

24 

1.30 

0.46 

2.41 

0.38 

40948 

B 

0 

15 

27 

0.58 

0.14 

0.92 

0.04 

40948 

C 

0 

9 

16 

0.14 

0.29 

0.64 

-0.14 

40948 

D 

0 

18 

33 

0.08 

0.24 

0.76 

-0.26 

40949 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40949 

A 

1 

36 

64 

1.09 

0.17 

0.97 

0.47 

40949 

B 

0 

7 

13 

0.56 

0.19 

1.13 

-0.04 

40949 

C 

0 

6 

11 

-0.06 

0.48 

0.86 

-0.22 

40949 

D 

0 

7 

13 

-0.65 

0.49 

0.55 

-0.43 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40950 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

40950 

A 

1 

19 

35 

1.49 

0.39 

1.35 

0.44 

40950 

B 

0 

5 

9 

-0.40 

0.32 

0.43 

-0.17 

40950 

C 

0 

17 

31 

0.36 

0.29 

1.32 

-0.06 

40950 

D 

0 

13 

24 

-0.41 

0.49 

0.89 

-0.31 

40951 

* 

-1 

4828 

99 

0.99 

0.02 

0.00 

-0.02 

40951 

A 

1 

52 

93 

1.39 

0.22 

0.91 

0.28 

40951 

B 

0 

1 

2 

2.23 

0.00 

6.36 

0.08 

40951 

C 

0 

3 

5 

-1.21 

0.21 

0.21 

-0.37 

40951 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40952 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.02 

40952 

A 

1 

50 

82 

0.96 

0.16 

0.84 

0.42 

40952 

B 

0 

1 

2 

0.69 

0.00 

1.44 

0.00 

40952 

C 

0 

6 

10 

0.01 

0.53 

1.63 

-0.19 

40952 

D 

0 

4 

7 

-1.18 

0.26 

0.25 

-0.41 

40953 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

-0.01 

40953 

A 

1 

36 

58 

1.69 

0.22 

0.93 

0.44 

40953 

B 

0 

6 

10 

0.01 

0.55 

0.60 

-0.23 

40953 

C 

0 

9 

15 

0.70 

0.50 

2.87 

-0.11 

40953 

D 

0 

11 

18 

0.11 

0.56 

0.98 

-0.29 

40954 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40954 

A 

1 

21 

38 

1.21 

0.20 

0.98 

0.38 

40954 

B 

0 

15 

27 

0.73 

0.23 

1.36 

0.01 

40954 

C 

0 

8 

15 

0.54 

0.35 

1.05 

-0.07 

40954 

D 

0 

11 

20 

-0.10 

0.30 

0.54 

-0.40 

40955 

* 

-1 

4828 

99 

0.99 

0.02 

0.00 

-0.02 

40955 

A 

1 

42 

75 

1.63 

0.22 

0.93 

0.46 

40955 

B 

0 

5 

9 

0.24 

0.34 

0.71 

-0.23 

40955 

C 

0 

6 

11 

0.41 

0.34 

0.81 

-0.21 

40955 

D 

0 

3 

5 

-0.53 

0.13 

0.26 

-0.30 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40956 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.02 

40956 

A 

1 

34 

67 

1.32 

0.23 

0.86 

0.54 

40956 

B 

0 

4 

8 

0.05 

0.32 

0.75 

-0.13 

40956 

C 

0 

4 

8 

0.52 

0.92 

2.71 

-0.04 

40956 

D 

0 

9 

18 

-1.10 

0.36 

0.32 

-0.54 

40957 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

40957 

A 

1 

45 

87 

0.93 

0.12 

0.85 

0.48 

40957 

B 

0 

1 

2 

1.58 

0.00 

3.07 

0.12 

40957 

C 

0 

4 

8 

-0.74 

0.42 

0.39 

-0.47 

40957 

D 

0 

2 

4 

-0.63 

0.55 

0.39 

-0.30 

40958 

* 

-1 

4632 

95 

0.97 

0.02 

0.00 

-0.08 

40958 

A 

1 

158 

63 

1.84 

0.08 

0.89 

0.47 

40958 

B 

0 

35 

14 

0.66 

0.17 

0.87 

-0.28 

40958 

C 

0 

51 

20 

0.99 

0.12 

1.03 

-0.20 

40958 

D 

0 

8 

3 

-0.31 

0.26 

0.26 

-0.28 

40959 

* 

-1 

4810 

98 

1.00 

0.02 

0.00 

0.00 

40959 

A 

1 

43 

58 

1.35 

0.24 

1.06 

0.32 

40959 

B 

0 

2 

3 

0.05 

0.22 

0.56 

-0.11 

40959 

C 

0 

12 

16 

0.16 

0.26 

0.90 

-0.25 

40959 

D 

0 

17 

23 

0.64 

0.29 

2.42 

-0.12 

40960 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40960 

A 

1 

18 

33 

1.70 

0.18 

0.65 

0.45 

40960 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40960 

C 

0 

25 

46 

0.60 

0.19 

0.99 

-0.12 

40960 

D 

0 

11 

20 

-0.30 

0.67 

0.74 

-0.38 

40961 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40961 

A 

1 

51 

91 

0.79 

0.20 

3.17 

0.31 

40961 

B 

0 

3 

5 

0.36 

0.35 

1.78 

-0.05 

40961 

C 

0 

1 

2 

-1.17 

0.00 

0.34 

-0.16 

40961 

D 

0 

1 

2 

-4.05 

0.00 

0.02 

-0.42 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40962 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

40962 

A 

1 

42 

76 

0.78 

0.15 

1.00 

0.33 

40962 

B 

0 

5 

9 

0.19 

0.23 

0.93 

-0.12 

40962 

C 

0 

5 

9 

-0.29 

0.65 

0.90 

-0.27 

40962 

D 

0 

3 

5 

0.07 

0.42 

0.85 

-0.12 

40963 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.03 

40963 

A 

1 

45 

76 

0.94 

0.17 

0.96 

0.42 

40963 

B 

0 

3 

5 

-1.07 

0.70 

0.40 

-0.35 

40963 

C 

0 

9 

15 

-0.11 

0.22 

0.75 

-0.28 

40963 

D 

0 

2 

3 

0.72 

0.41 

1.52 

0.01 

40964 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.02 

40964 

A 

1 

38 

76 

1.13 

0.23 

1.02 

0.44 

40964 

B 

0 

2 

4 

-0.53 

1.53 

0.98 

-0.19 

40964 

C 

0 

10 

20 

-0.29 

0.23 

0.65 

-0.37 

40964 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40965 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

40965 

A 

1 

38 

70 

1.33 

0.21 

0.84 

0.49 

40965 

B 

0 

4 

7 

1.00 

0.67 

2.71 

0.02 

40965 

C 

0 

4 

7 

-0.29 

0.45 

0.57 

-0.24 

40965 

D 

0 

8 

15 

-0.67 

0.25 

0.37 

-0.47 

40966 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.00 

40966 

A 

1 

36 

72 

1.34 

0.26 

1.09 

0.39 

40966 

B 

0 

3 

6 

0.62 

0.28 

1.27 

-0.05 

40966 

C 

0 

6 

12 

-0.03 

0.61 

1.54 

-0.23 

40966 

D 

0 

5 

10 

-0.49 

0.74 

1.01 

-0.30 

40967 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40967 

A 

1 

19 

35 

2.03 

0.39 

1.35 

0.57 

40967 

B 

0 

8 

15 

0.42 

0.39 

0.93 

-0.14 

40967 

C 

0 

2 

4 

-0.20 

0.48 

0.36 

-0.15 

40967 

D 

0 

26 

47 

0.31 

0.15 

0.69 

-0.39 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40968 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

40968 

A 

1 

19 

35 

1.38 

0.34 

1.41 

0.32 

40968 

B 

0 

9 

16 

0.31 

0.24 

0.65 

-0.21 

40968 

C 

0 

7 

13 

0.72 

0.38 

1.14 

-0.05 

40968 

D 

0 

20 

36 

0.69 

0.21 

1.02 

-0.12 

40969 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

-0.01 

40969 

A 

1 

17 

30 

1.62 

0.35 

1.39 

0.32 

40969 

B 

0 

17 

30 

1.09 

0.17 

1.07 

0.01 

40969 

C 

0 

3 

5 

0.11 

0.30 

0.37 

-0.20 

40969 

D 

0 

20 

35 

0.72 

0.24 

1.12 

-0.22 

40970 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40970 

A 

1 

11 

20 

1.52 

0.45 

1.16 

0.42 

40970 

B 

0 

12 

22 

0.06 

0.31 

0.82 

-0.17 

40970 

C 

0 

9 

16 

0.42 

0.41 

1.22 

-0.01 

40970 

D 

0 

23 

42 

0.17 

0.22 

0.83 

-0.19 

40971 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.00 

40971 

A 

1 

41 

68 

1.20 

0.19 

1.25 

0.25 

40971 

B 

0 

3 

5 

0.88 

0.51 

1.33 

-0.02 

40971 

C 

0 

10 

17 

0.82 

0.29 

1.53 

-0.06 

40971 

D 

0 

6 

10 

-0.16 

0.72 

0.91 

-0.30 

40972 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

40972 

A 

1 

31 

61 

1.34 

0.31 

2.81 

0.32 

40972 

B 

0 

7 

14 

0.58 

0.33 

1.20 

-0.10 

40972 

C 

0 

6 

12 

0.50 

0.17 

0.86 

-0.11 

40972 

D 

0 

7 

14 

0.04 

0.29 

0.64 

-0.25 

40973 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.03 

40973 

A 

1 

22 

44 

1.19 

0.28 

3.32 

0.38 

40973 

B 

0 

9 

18 

0.32 

0.21 

0.79 

-0.08 

40973 

C 

0 

8 

16 

0.44 

0.49 

1.93 

-0.04 

40973 

D 

0 

11 

22 

-0.37 

0.56 

0.70 

-0.34 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40974 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.00 

40974 

A 

1 

19 

37 

1.58 

0.42 

1.59 

0.27 

40974 

B 

0 

14 

27 

1.36 

0.39 

6.35 

0.13 

40974 

C 

0 

11 

21 

-0.09 

0.24 

0.48 

-0.38 

40974 

D 

0 

8 

15 

0.76 

0.29 

1.07 

-0.08 

40975 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.00 

40975 

A 

1 

14 

25 

1.33 

0.40 

2.11 

0.19 

40975 

B 

0 

25 

45 

1.20 

0.18 

1.40 

0.19 

40975 

C 

0 

8 

14 

0.28 

0.27 

0.52 

-0.27 

40975 

D 

0 

9 

16 

0.45 

0.14 

0.52 

-0.22 

40976 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

40976 

A 

1 

16 

30 

1.81 

0.37 

0.86 

0.53 

40976 

B 

0 

16 

30 

0.34 

0.24 

0.84 

-0.21 

40976 

C 

0 

6 

11 

0.42 

0.29 

0.81 

-0.09 

40976 

D 

0 

16 

30 

0.25 

0.25 

0.82 

-0.26 

40977 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

0.03 

40977 

A 

1 

23 

49 

1.08 

0.28 

1.23 

0.30 

40977 

B 

0 

3 

6 

0.19 

0.75 

1.15 

-0.09 

40977 

C 

0 

5 

11 

0.62 

0.26 

1.13 

-0.01 

40977 

D 

0 

16 

34 

0.19 

0.36 

1.28 

-0.26 

40978 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

40978 

A 

1 

20 

41 

1.26 

0.38 

1.35 

0.29 

40978 

B 

0 

11 

22 

0.46 

0.22 

1.05 

-0.13 

40978 

C 

0 

8 

16 

1.04 

0.16 

1.56 

0.08 

40978 

D 

0 

10 

20 

-0.02 

0.39 

0.75 

-0.30 

40979 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.00 

40979 

A 

1 

25 

49 

1.54 

0.32 

2.26 

0.32 

40979 

B 

0 

10 

20 

0.95 

0.47 

2.81 

-0.02 

40979 

C 

0 

10 

20 

0.79 

0.34 

1.24 

-0.06 

40979 

D 

0 

6 

12 

-0.78 

0.76 

0.41 

-0.40 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40980 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

40980 

A 

1 

23 

40 

1.56 

0.25 

0.89 

0.42 

40980 

B 

0 

3 

5 

0.59 

0.27 

0.75 

-0.04 

40980 

C 

0 

16 

28 

0.85 

0.27 

2.13 

0.01 

40980 

D 

0 

15 

26 

-0.29 

0.43 

0.64 

-0.46 

40981 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

40981 

A 

1 

21 

38 

1.05 

0.22 

1.02 

0.40 

40981 

B 

0 

4 

7 

-0.22 

0.65 

0.69 

-0.19 

40981 

C 

0 

8 

15 

0.90 

0.30 

1.69 

0.15 

40981 

D 

0 

22 

40 

-0.01 

0.19 

0.76 

-0.40 

40982 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.04 

40982 

A 

1 

23 

40 

1.05 

0.20 

0.94 

0.41 

40982 

B 

0 

10 

17 

0.28 

0.26 

0.93 

-0.14 

40982 

C 

0 

5 

9 

0.63 

0.53 

1.45 

0.02 

40982 

D 

0 

20 

34 

0.14 

0.17 

0.80 

-0.33 

40983 

* 

-1 

4639 

95 

0.99 

0.02 

0.00 

-0.04 

40983 

A 

1 

160 

65 

1.56 

0.08 

1.07 

0.42 

40983 

B 

0 

35 

14 

0.51 

0.10 

0.70 

-0.28 

40983 

C 

0 

39 

16 

0.79 

0.13 

1.09 

-0.18 

40983 

D 

0 

11 

4 

0.38 

0.24 

0.67 

-0.17 

40984 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

40984 

A 

1 

18 

32 

1.36 

0.27 

0.95 

0.48 

40984 

B 

0 

7 

13 

0.11 

0.30 

0.66 

-0.14 

40984 

C 

0 

12 

21 

0.61 

0.29 

1.26 

0.03 

40984 

D 

0 

19 

34 

-0.13 

0.23 

0.64 

-0.40 

40985 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.02 

40985 

A 

1 

17 

35 

1.53 

0.25 

0.85 

0.45 

40985 

B 

0 

11 

22 

1.04 

0.36 

1.64 

0.11 

40985 

C 

0 

4 

8 

0.05 

0.41 

0.51 

-0.19 

40985 

D 

0 

17 

35 

0.08 

0.23 

0.59 

-0.44 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40986 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40986 

A 

1 

21 

38 

1.31 

0.30 

1.43 

0.39 

40986 

B 

0 

18 

33 

0.42 

0.19 

0.94 

-0.20 

40986 

C 

0 

7 

13 

0.28 

0.36 

0.80 

-0.15 

40986 

D 

0 

9 

16 

0.44 

0.33 

1.00 

-0.12 

40987 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.01 

40987 

A 

1 

16 

33 

2.59 

0.47 

0.76 

0.62 

40987 

B 

0 

12 

25 

0.60 

0.16 

0.74 

-0.09 

40987 

C 

0 

4 

8 

0.12 

0.34 

0.48 

-0.12 

40987 

D 

0 

16 

33 

-0.38 

0.45 

0.59 

-0.46 

40988 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.04 

40988 

A 

1 

53 

87 

0.81 

0.16 

1.14 

0.50 

40988 

B 

0 

1 

2 

0.25 

0.00 

1.34 

-0.03 

40988 

C 

0 

2 

3 

-2.36 

0.48 

0.11 

-0.39 

40988 

D 

0 

5 

8 

-1.05 

0.79 

0.70 

-0.35 

40989 

* 

-1 

4641 

95 

0.98 

0.02 

0.00 

-0.05 

40989 

A 

1 

222 

91 

1.38 

0.07 

0.98 

0.34 

40989 

B 

0 

5 

2 

-0.10 

0.36 

0.52 

-0.18 

40989 

C 

0 

12 

5 

0.42 

0.28 

1.11 

-0.17 

40989 

D 

0 

4 

2 

-0.99 

0.82 

0.30 

-0.26 

40990 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40990 

A 

1 

43 

77 

1.09 

0.22 

1.00 

0.45 

40990 

B 

0 

4 

7 

0.16 

0.30 

0.94 

-0.09 

40990 

C 

0 

3 

5 

-0.22 

0.80 

1.13 

-0.13 

40990 

D 

0 

6 

11 

-1.47 

0.94 

0.57 

-0.44 

40991 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40991 

A 

1 

49 

88 

0.89 

0.15 

0.99 

0.36 

40991 

B 

0 

2 

4 

0.12 

0.09 

0.76 

-0.12 

40991 

C 

0 

1 

2 

-0.07 

0.00 

0.63 

-0.11 

40991 

D 

0 

4 

7 

-0.42 

0.33 

0.53 

-0.32 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40992 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

40992 

A 

1 

38 

69 

1.28 

0.20 

0.78 

0.55 

40992 

B 

0 

7 

13 

0.09 

0.43 

1.05 

-0.19 

40992 

C 

0 

5 

9 

-0.76 

0.28 

0.35 

-0.35 

40992 

D 

0 

5 

9 

-0.64 

0.30 

0.41 

-0.32 

40993 

* 

-1 

4816 

99 

1.00 

0.02 

0.00 

0.00 

40993 

A 

1 

45 

66 

1.29 

0.22 

1.19 

0.34 

40993 

B 

0 

18 

26 

0.41 

0.18 

1.04 

-0.24 

40993 

C 

0 

3 

4 

-0.14 

0.36 

0.52 

-0.17 

40993 

D 

0 

2 

3 

0.02 

0.07 

0.54 

-0.12 

40994 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.00 

40994 

A 

1 

39 

67 

1.51 

0.21 

0.89 

0.54 

40994 

B 

0 

1 

2 

0.16 

0.00 

0.59 

-0.08 

40994 

C 

0 

12 

21 

0.05 

0.16 

0.61 

-0.37 

40994 

D 

0 

6 

10 

-0.20 

0.23 

0.47 

-0.31 

40995 

* 

-1 

4836 

99 

1.00 

0.02 

0.00 

0.01 

40995 

A 

1 

31 

65 

1.38 

0.25 

0.90 

0.46 

40995 

B 

0 

5 

10 

0.47 

0.21 

0.94 

-0.12 

40995 

C 

0 

9 

19 

-0.06 

0.27 

0.68 

-0.35 

40995 

D 

0 

3 

6 

-0.04 

0.73 

0.92 

-0.19 

40996 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40996 

A 

1 

30 

54 

1.45 

0.19 

0.73 

0.62 

40996 

B 

0 

3 

5 

-0.26 

0.57 

0.51 

-0.21 

40996 

C 

0 

18 

32 

0.02 

0.16 

0.64 

-0.45 

40996 

D 

0 

5 

9 

0.13 

0.35 

0.73 

-0.18 

40997 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

40997 

A 

1 

20 

36 

1.42 

0.35 

1.22 

0.49 

40997 

B 

0 

7 

13 

-0.02 

0.32 

0.68 

-0.19 

40997 

C 

0 

25 

45 

0.18 

0.14 

0.76 

-0.30 

40997 

D 

0 

4 

7 

0.11 

0.59 

0.95 

-0.11 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40998 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

40998 

A 

1 

30 

54 

1.51 

0.25 

0.82 

0.54 

40998 

B 

0 

4 

7 

-0.45 

0.55 

0.48 

-0.22 

40998 

C 

0 

20 

36 

0.19 

0.16 

0.81 

-0.27 

40998 

D 

0 

2 

4 

-2.62 

2.33 

0.20 

-0.43 

40999 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

-0.01 

40999 

A 

1 

38 

69 

1.59 

0.26 

1.03 

0.43 

40999 

B 

0 

11 

20 

0.60 

0.18 

1.10 

-0.18 

40999 

C 

0 

5 

9 

-0.46 

0.27 

0.37 

-0.33 

40999 

D 

0 

1 

2 

-1.74 

0.00 

0.09 

-0.25 

41000 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

0.01 

41000 

A 

1 

34 

72 

1.19 

0.21 

0.92 

0.43 

41000 

B 

0 

3 

6 

0.12 

0.56 

0.89 

-0.15 

41000 

C 

0 

2 

4 

0.77 

0.46 

1.36 

-0.01 

41000 

D 

0 

8 

17 

-0.33 

0.45 

0.76 

-0.41 

41001 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.04 

41001 

A 

1 

33 

56 

1.06 

0.17 

0.97 

0.43 

41001 

B 

0 

7 

12 

-0.09 

0.41 

0.79 

-0.18 

41001 

C 

0 

14 

24 

0.26 

0.24 

1.05 

-0.12 

41001 

D 

0 

5 

8 

-1.14 

1.18 

0.61 

-0.39 

41002 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.00 

41002 

A 

1 

30 

54 

1.37 

0.25 

1.31 

0.32 

41002 

B 

0 

10 

18 

1.24 

0.33 

2.08 

0.09 

41002 

C 

0 

11 

20 

0.09 

0.25 

0.59 

-0.34 

41002 

D 

0 

5 

9 

0.12 

0.53 

0.66 

-0.21 

41003 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

41003 

A 

1 

25 

49 

1.41 

0.33 

1.36 

0.36 

41003 

B 

0 

15 

29 

0.70 

0.33 

2.10 

-0.05 

41003 

C 

0 

5 

10 

0.13 

0.36 

0.67 

-0.14 

41003 

D 

0 

6 

12 

-0.69 

0.75 

0.54 

-0.35 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41004 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

41004 

A 

1 

26 

47 

1.33 

0.36 

1.15 

0.41 

41004 

B 

0 

6 

11 

-0.10 

0.68 

2.38 

-0.13 

41004 

C 

0 

14 

25 

0.34 

0.22 

1.22 

-0.08 

41004 

D 

0 

9 

16 

-0.81 

0.60 

0.61 

-0.35 

41005 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

41005 

A 

1 

25 

46 

1.01 

0.20 

1.17 

0.30 

41005 

B 

0 

5 

9 

1.03 

0.20 

1.47 

0.11 

41005 

C 

0 

10 

19 

0.50 

0.24 

1.07 

-0.09 

41005 

D 

0 

14 

26 

0.11 

0.32 

0.91 

-0.33 

41006 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.01 

41006 

A 

1 

30 

49 

1.29 

0.24 

1.25 

0.33 

41006 

B 

0 

3 

5 

0.21 

0.30 

0.59 

-0.12 

41006 

C 

0 

15 

25 

0.49 

0.34 

1.32 

-0.17 

41006 

D 

0 

13 

21 

0.49 

0.24 

1.07 

-0.16 

41007 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.02 

41007 

A 

1 

27 

44 

1.53 

0.25 

0.86 

0.51 

41007 

B 

0 

9 

15 

0.43 

0.30 

1.15 

-0.09 

41007 

C 

0 

11 

18 

0.32 

0.36 

1.31 

-0.14 

41007 

D 

0 

14 

23 

-0.30 

0.36 

0.65 

-0.40 

41008 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

41008 

A 

1 

30 

55 

1.11 

0.26 

1.55 

0.26 

41008 

B 

0 

8 

15 

0.78 

0.44 

1.63 

-0.01 

41008 

C 

0 

10 

18 

0.35 

0.23 

0.84 

-0.18 

41008 

D 

0 

7 

13 

0.29 

0.22 

0.75 

-0.17 

41009 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

41009 

A 

1 

26 

47 

1.59 

0.30 

1.24 

0.43 

41009 

B 

0 

6 

11 

0.32 

0.40 

0.80 

-0.16 

41009 

C 

0 

8 

15 

0.62 

0.49 

1.49 

-0.10 

41009 

D 

0 

15 

27 

0.26 

0.24 

0.86 

-0.30 
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Item  ID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41010 

* 

-1 

4817 

99 

1.00 

0.02 

0.00 

0.02 

41010 

A 

-1 

67 

100 

0.80 

0.15 

0.00 

0.00 

41010 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41010 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41010 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41011 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.03 

41011 

A 

1 

54 

95 

0.75 

0.17 

0.89 

0.36 

41011 

B 

0 

1 

2 

-2.89 

0.00 

0.06 

-0.36 

41011 

C 

0 

1 

2 

0.02 

0.00 

1.09 

-0.06 

41011 

D 

0 

1 

2 

-1.09 

0.00 

0.36 

-0.18 

41012 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.00 

41012 

A 

-1 

62 

100 

0.97 

0.15 

0.00 

0.00 

41012 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41012 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41012 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41013 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.04 

41013 

A 

-1 

56 

100 

0.49 

0.16 

0.00 

0.00 

41013 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41013 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41013 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41014 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.04 

41014 

A 

1 

48 

91 

0.65 

0.21 

1.18 

0.25 

41014 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41014 

C 

0 

2 

4 

1.02 

0.82 

4.83 

0.06 

41014 

D 

0 

3 

6 

-1.79 

1.13 

0.45 

-0.36 

41015 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

41015 

A 

-1 

55 

100 

0.64 

0.17 

0.00 

0.00 

41015 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41015 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41015 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41016 

* 

-1 

4816 

99 

1.00 

0.02 

0.00 

0.01 

41016 

A 

-1 

68 

100 

0.87 

0.13 

0.00 

0.00 

41016 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41016 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41016 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

41017 

* 

-1 

4813 

99 

1.00 

0.02 

0.00 

0.03 

41017 

A 

1 

66 

93 

0.69 

0.14 

1.11 

0.08 

41017 

B 

0 

2 

3 

-0.08 

0.24 

0.80 

-0.11 

41017 

C 

0 

3 

4 

0.64 

0.78 

2.99 

0.00 

41017 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41018 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.03 

41018 

A 

1 

48 

91 

0.91 

0.19 

0.70 

0.51 

41018 

B 

0 

1 

2 

-1.25 

0.00 

0.30 

-0.17 

41018 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41018 

D 

0 

4 

8 

-1.88 

0.79 

0.29 

-0.48 

41019 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

41019 

A 

1 

47 

87 

1.05 

0.19 

0.86 

0.40 

41019 

B 

0 

2 

4 

-0.96 

1.93 

0.99 

-0.26 

41019 

C 

0 

3 

6 

-0.72 

0.40 

0.42 

-0.28 

41019 

D 

0 

2 

4 

0.01 

0.10 

0.75 

-0.12 

41020 

* 

-1 

4814 

99 

1.00 

0.02 

0.00 

0.02 

41020 

A 

1 

61 

87 

0.93 

0.16 

0.99 

0.36 

41020 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41020 

C 

0 

2 

3 

-0.43 

0.32 

0.53 

-0.16 

41020 

D 

0 

7 

10 

-0.43 

0.25 

0.63 

-0.31 

41021 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

41021 

A 

1 

44 

86 

0.90 

0.19 

1.08 

0.11 

41021 

B 

0 

2 

4 

1.47 

1.46 

6.76 

0.10 

41021 

C 

0 

1 

2 

0.62 

0.00 

1.27 

-0.03 

41021 

D 

0 

4 

8 

-0.02 

0.58 

1.02 

-0.20 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41022 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.01 

41022 

A 

1 

44 

85 

1.18 

0.22 

0.83 

0.42 

41022 

B 

0 

2 

4 

0.71 

0.16 

1.53 

-0.02 

41022 

C 

0 

1 

2 

-0.27 

0.00 

0.56 

-0.11 

41022 

D 

0 

5 

10 

-1.24 

0.46 

0.29 

-0.45 

41023 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

41023 

A 

1 

49 

89 

0.94 

0.17 

1.05 

0.48 

41023 

B 

0 

3 

5 

-0.04 

0.19 

0.76 

-0.12 

41023 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41023 

D 

0 

3 

5 

-2.66 

1.60 

0.28 

-0.54 

41024 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.00 

41024 

A 

1 

45 

80 

1.12 

0.18 

1.07 

0.17 

41024 

B 

0 

2 

4 

0.54 

1.17 

1.57 

-0.08 

41024 

C 

0 

3 

5 

1.00 

0.28 

1.51 

0.00 

41024 

D 

0 

6 

11 

0.43 

0.62 

2.15 

-0.17 

41025 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.04 

41025 

A 

1 

41 

82 

0.96 

0.19 

0.81 

0.57 

41025 

B 

0 

3 

6 

-0.60 

0.40 

0.52 

-0.18 

41025 

C 

0 

3 

6 

-1.51 

0.48 

0.23 

-0.33 

41025 

D 

0 

3 

6 

-2.11 

1.88 

0.74 

-0.42 

41026 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.00 

41026 

A 

1 

51 

85 

1.16 

0.20 

1.09 

0.33 

41026 

B 

0 

3 

5 

0.34 

0.50 

1.05 

-0.09 

41026 

C 

0 

2 

3 

0.50 

1.22 

1.83 

-0.05 

41026 

D 

0 

4 

7 

-1.21 

1.37 

0.89 

-0.36 

41027 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.04 

41027 

A 

1 

21 

38 

1.10 

0.28 

1.08 

0.36 

41027 

B 

0 

4 

7 

0.09 

0.75 

1.51 

-0.10 

41027 

C 

0 

8 

15 

0.33 

0.41 

1.61 

-0.07 

41027 

D 

0 

22 

40 

0.14 

0.23 

1.08 

-0.26 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41028 

* 

-1 

4811 

99 

1.00 

0.02 

0.00 

0.03 

41028 

A 

1 

39 

53 

1.00 

0.12 

0.92 

0.39 

41028 

B 

0 

11 

15 

0.36 

0.25 

1.08 

-0.15 

41028 

C 

0 

8 

11 

0.43 

0.38 

1.39 

-0.10 

41028 

D 

0 

15 

21 

0.20 

0.24 

0.93 

-0.27 

41029 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.00 

41029 

A 

1 

6 

10 

3.94 

1.20 

2.91 

0.57 

41029 

B 

0 

1 

2 

-0.12 

0.00 

0.21 

-0.09 

41029 

C 

0 

45 

78 

0.90 

0.15 

0.88 

-0.13 

41029 

D 

0 

6 

10 

-0.77 

0.74 

0.42 

-0.35 

41030 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

41030 

A 

1 

34 

60 

1.07 

0.25 

1.15 

0.31 

41030 

B 

0 

5 

9 

0.35 

0.34 

1.08 

-0.08 

41030 

C 

0 

7 

12 

0.59 

0.59 

3.63 

-0.03 

41030 

D 

0 

11 

19 

-0.18 

0.40 

0.90 

-0.30 

41031 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.00 

41031 

A 

1 

33 

62 

1.63 

0.28 

0.88 

0.47 

41031 

B 

0 

6 

11 

-0.18 

0.38 

0.60 

-0.29 

41031 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41031 

D 

0 

14 

26 

0.25 

0.23 

0.93 

-0.32 

41032 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

-0.01 

41032 

A 

1 

36 

59 

1.34 

0.16 

0.99 

0.33 

41032 

B 

0 

8 

13 

1.55 

0.37 

2.76 

0.19 

41032 

C 

0 

5 

8 

-0.17 

0.20 

0.35 

-0.36 

41032 

D 

0 

12 

20 

0.41 

0.20 

0.71 

-0.31 

41033 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

41033 

A 

1 

30 

56 

1.34 

0.23 

1.04 

0.44 

41033 

B 

0 

12 

22 

0.60 

0.30 

1.37 

-0.11 

41033 

C 

0 

4 

7 

-0.54 

0.40 

0.35 

-0.32 

41033 

D 

0 

8 

15 

0.13 

0.24 

0.67 

-0.25 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41034 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.00 

41034 

A 

1 

33 

62 

1.44 

0.18 

0.95 

0.48 

41034 

B 

0 

3 

6 

1.09 

0.26 

1.32 

0.02 

41034 

C 

0 

5 

9 

0.70 

0.51 

1.27 

-0.09 

41034 

D 

0 

12 

23 

-0.08 

0.29 

0.59 

-0.50 

41035 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

41035 

A 

1 

20 

36 

1.52 

0.35 

1.24 

0.44 

41035 

B 

0 

30 

54 

0.29 

0.21 

1.00 

-0.30 

41035 

C 

0 

1 

2 

1.23 

0.00 

1.52 

0.05 

41035 

D 

0 

5 

9 

-0.41 

0.39 

0.43 

-0.24 

41036 

* 

-1 

4840 

99 

1.00 

0.02 

0.00 

-0.02 

41036 

A 

1 

14 

32 

1.72 

0.48 

2.41 

0.25 

41036 

B 

0 

28 

64 

1.02 

0.22 

1.11 

-0.18 

41036 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41036 

D 

0 

2 

5 

0.26 

0.72 

0.38 

-0.15 

41037 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.04 

41037 

A 

1 

14 

26 

1.10 

0.30 

1.52 

0.27 

41037 

B 

0 

33 

62 

0.64 

0.16 

1.22 

0.12 

41037 

C 

0 

2 

4 

-1.13 

1.34 

0.28 

-0.25 

41037 

D 

0 

4 

8 

-1.72 

0.95 

0.21 

-0.49 

41038 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

41038 

A 

1 

17 

31 

1.00 

0.41 

1.80 

0.21 

41038 

B 

0 

34 

62 

0.53 

0.17 

1.49 

-0.07 

41038 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41038 

D 

0 

4 

7 

-0.53 

0.22 

0.32 

-0.25 

41039 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.03 

41039 

A 

1 

18 

29 

1.14 

0.19 

0.98 

0.31 

41039 

B 

0 

41 

65 

0.55 

0.16 

1.25 

-0.07 

41039 

C 

0 

2 

3 

-1.07 

0.14 

0.15 

-0.28 

41039 

D 

0 

2 

3 

-1.45 

0.29 

0.11 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41040 

* 

-1 

4827 

99 

0.99 

0.02 

0.00 

-0.02 

41040 

A 

1 

16 

28 

2.28 

0.58 

2.93 

0.39 

41040 

B 

0 

36 

63 

0.87 

0.18 

1.12 

-0.32 

41040 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41040 

D 

0 

5 

9 

0.88 

0.39 

0.94 

-0.07 

41041 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.03 

41041 

A 

1 

18 

35 

1.34 

0.33 

1.11 

0.32 

41041 

B 

0 

30 

58 

0.65 

0.20 

1.53 

0.01 

41041 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41041 

D 

0 

4 

8 

-2.69 

1.11 

0.13 

-0.59 

41042 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

41042 

A 

1 

14 

25 

1.19 

0.45 

1.72 

0.27 

41042 

B 

0 

35 

64 

0.56 

0.18 

1.23 

-0.06 

41042 

C 

0 

2 

4 

-0.29 

0.65 

0.41 

-0.14 

41042 

D 

0 

4 

7 

-0.41 

0.37 

0.35 

-0.23 

41043 

* 

-1 

4837 

99 

1.00 

0.02 

0.00 

0.02 

41043 

A 

1 

43 

91 

0.76 

0.15 

1.00 

0.25 

41043 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41043 

C 

0 

1 

2 

-0.05 

0.00 

0.72 

-0.10 

41043 

D 

0 

3 

6 

-0.21 

0.77 

1.04 

-0.23 

41044 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.00 

41044 

A 

1 

45 

83 

1.18 

0.21 

1.10 

0.32 

41044 

B 

0 

9 

17 

0.00 

0.20 

0.70 

-0.32 

41044 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41044 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41045 

* 

-1 

4813 

99 

1.00 

0.02 

0.00 

0.02 

41045 

A 

1 

60 

85 

0.99 

0.13 

0.96 

0.47 

41045 

B 

0 

9 

13 

-0.23 

0.19 

0.55 

-0.29 

41045 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41045 

D 

0 

2 

3 

-2.55 

2.99 

0.94 

-0.44 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41046 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.00 

41046 

A 

1 

48 

98 

1.03 

0.15 

0.92 

0.29 

41046 

B 

0 

1 

2 

-1.22 

0.00 

0.18 

-0.29 

41046 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41046 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41047 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

41047 

A 

1 

51 

94 

0.94 

0.20 

0.98 

0.25 

41047 

B 

0 

1 

2 

-0.51 

0.00 

0.49 

-0.13 

41047 

C 

0 

1 

2 

-0.34 

0.00 

0.58 

-0.11 

41047 

D 

0 

1 

2 

-1.06 

0.00 

0.28 

-0.18 

41048 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

-0.01 

41048 

A 

1 

52 

95 

1.21 

0.23 

0.96 

0.28 

41048 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41048 

C 

0 

2 

4 

-1.32 

0.48 

0.24 

-0.29 

41048 

D 

0 

1 

2 

0.31 

0.00 

1.12 

-0.07 

41049 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

-0.01 

41049 

A 

1 

49 

91 

1.30 

0.17 

0.89 

0.37 

41049 

B 

0 

2 

4 

-1.02 

0.33 

0.21 

-0.34 

41049 

C 

0 

1 

2 

0.00 

0.00 

0.54 

-0.12 

41049 

D 

0 

2 

4 

0.20 

1.05 

1.06 

-0.15 

41050 

* 

-1 

1835 

38 

1.36 

0.03 

0.00 

0.22 

41050 

A 

1 

2676 

88 

0.98 

0.02 

0.92 

0.41 

41050 

B 

0 

75 

2 

-0.41 

0.13 

1.20 

-0.14 

41050 

C 

0 

153 

5 

-0.47 

0.08 

0.70 

-0.22 

41050 

D 

0 

145 

5 

-0.99 

0.13 

0.59 

-0.30 

41051 

* 

-1 

4811 

99 

1.00 

0.02 

0.00 

0.03 

41051 

A 

1 

41 

56 

1.19 

0.19 

0.96 

0.46 

41051 

B 

0 

10 

14 

-0.09 

0.39 

0.76 

-0.25 

41051 

C 

0 

10 

14 

-0.14 

0.24 

0.63 

-0.26 

41051 

D 

0 

12 

16 

0.30 

0.27 

1.09 

-0.14 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41052 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.02 

41052 

A 

1 

39 

66 

1.25 

0.22 

0.82 

0.51 

41052 

B 

0 

2 

3 

-0.11 

0.48 

0.66 

-0.11 

41052 

C 

0 

10 

17 

-0.27 

0.40 

1.06 

-0.31 

41052 

D 

0 

8 

14 

-0.37 

0.33 

0.66 

-0.30 

41053 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

41053 

A 

1 

37 

69 

1.10 

0.17 

1.06 

0.44 

41053 

B 

0 

8 

15 

0.18 

0.31 

0.94 

-0.23 

41053 

C 

0 

5 

9 

0.08 

0.42 

0.89 

-0.21 

41053 

D 

0 

4 

7 

-0.14 

0.50 

0.77 

-0.24 

41054 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.00 

41054 

A 

1 

31 

55 

1.69 

0.21 

0.81 

0.60 

41054 

B 

0 

12 

21 

0.53 

0.24 

0.97 

-0.17 

41054 

C 

0 

4 

7 

-0.33 

0.68 

0.54 

-0.27 

41054 

D 

0 

9 

16 

-0.38 

0.20 

0.33 

-0.44 

41055 

* 

-1 

4823 

99 

1.00 

0.02 

0.00 

0.04 

41055 

A 

1 

33 

54 

1.11 

0.20 

0.80 

0.54 

41055 

B 

0 

11 

18 

-0.03 

0.25 

0.86 

-0.21 

41055 

C 

0 

8 

13 

-0.01 

0.13 

0.69 

-0.17 

41055 

D 

0 

9 

15 

-0.56 

0.41 

0.57 

-0.37 

41056 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

41056 

A 

1 

32 

59 

1.45 

0.27 

0.92 

0.48 

41056 

B 

0 

9 

17 

-0.31 

0.28 

0.55 

-0.36 

41056 

C 

0 

5 

9 

0.61 

0.27 

1.19 

-0.06 

41056 

D 

0 

8 

15 

0.02 

0.33 

0.82 

-0.24 

41057 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

41057 

A 

1 

39 

71 

1.44 

0.21 

0.87 

0.50 

41057 

B 

0 

9 

16 

0.04 

0.19 

0.60 

-0.34 

41057 

C 

0 

4 

7 

0.24 

0.38 

0.78 

-0.17 

41057 

D 

0 

3 

5 

-0.28 

0.55 

0.48 

-0.24 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41058 

* 

-1 

4830 

99 

1.01 

0.02 

0.00 

0.05 

41058 

A 

1 

34 

63 

0.91 

0.19 

0.81 

0.59 

41058 

B 

0 

4 

7 

-0.10 

0.46 

1.04 

-0.10 

41058 

C 

0 

5 

9 

-0.75 

0.24 

0.46 

-0.28 

41058 

D 

0 

11 

20 

-0.75 

0.28 

0.58 

-0.44 

41059 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.00 

41059 

A 

1 

35 

60 

1.39 

0.19 

0.99 

0.47 

41059 

B 

0 

5 

9 

0.75 

0.31 

1.12 

-0.05 

41059 

C 

0 

9 

16 

0.28 

0.34 

0.80 

-0.24 

41059 

D 

0 

9 

16 

-0.03 

0.24 

0.53 

-0.36 

41060 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.00 

41060 

A 

1 

32 

56 

1.56 

0.18 

0.76 

0.51 

41060 

B 

0 

3 

5 

-0.66 

0.39 

0.24 

-0.30 

41060 

C 

0 

8 

14 

0.89 

0.30 

1.17 

-0.03 

41060 

D 

0 

14 

25 

0.05 

0.37 

0.98 

-0.41 

41061 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

-0.01 

41061 

A 

1 

43 

77 

1.53 

0.18 

0.80 

0.55 

41061 

B 

0 

7 

13 

0.17 

0.29 

0.71 

-0.27 

41061 

C 

0 

1 

2 

-0.43 

0.00 

0.31 

-0.16 

41061 

D 

0 

5 

9 

-0.66 

0.28 

0.28 

-0.42 

41062 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

41062 

A 

1 

35 

64 

1.42 

0.20 

0.72 

0.55 

41062 

B 

0 

2 

4 

1.22 

0.41 

1.92 

0.05 

41062 

C 

0 

11 

20 

-0.25 

0.16 

0.46 

-0.47 

41062 

D 

0 

7 

13 

0.07 

0.30 

0.75 

-0.26 

41063 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

41063 

A 

1 

31 

57 

1.30 

0.18 

0.85 

0.60 

41063 

B 

0 

8 

15 

0.18 

0.19 

0.72 

-0.20 

41063 

C 

0 

9 

17 

0.02 

0.25 

0.68 

-0.28 

41063 

D 

0 

6 

11 

-0.54 

0.38 

0.42 

-0.40 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41064 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

-0.02 

41064 

A 

1 

49 

89 

1.41 

0.17 

1.00 

0.41 

41064 

B 

0 

2 

4 

-0.46 

0.75 

0.41 

-0.26 

41064 

C 

0 

2 

4 

-0.01 

0.12 

0.50 

-0.19 

41064 

D 

0 

2 

4 

-0.26 

0.09 

0.39 

-0.23 

41065 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.00 

41065 

A 

1 

43 

86 

1.15 

0.19 

0.99 

0.32 

41065 

B 

0 

2 

4 

-0.09 

0.27 

0.52 

-0.18 

41065 

C 

0 

2 

4 

0.82 

0.54 

1.43 

-0.03 

41065 

D 

0 

3 

6 

-0.40 

0.21 

0.38 

-0.29 

41066 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

41066 

A 

1 

37 

67 

1.10 

0.22 

1.02 

0.45 

41066 

B 

0 

3 

5 

0.53 

0.15 

1.14 

-0.03 

41066 

C 

0 

7 

13 

-0.07 

0.21 

0.71 

-0.23 

41066 

D 

0 

8 

15 

-0.41 

0.14 

0.47 

-0.36 

41067 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.04 

41067 

A 

1 

43 

80 

1.01 

0.19 

0.76 

0.55 

41067 

B 

0 

2 

4 

-1.94 

1.32 

0.23 

-0.31 

41067 

C 

0 

4 

7 

-0.31 

0.70 

1.37 

-0.16 

41067 

D 

0 

5 

9 

-1.52 

0.92 

0.48 

-0.42 

41068 

* 

-1 

4838 

99 

1.00 

0.02 

0.00 

0.01 

41068 

A 

1 

36 

78 

1.26 

0.17 

0.79 

0.55 

41068 

B 

0 

1 

2 

1.17 

0.00 

1.86 

0.03 

41068 

C 

0 

5 

11 

-0.65 

0.55 

0.59 

-0.43 

41068 

D 

0 

4 

9 

-0.49 

0.50 

0.52 

-0.34 

41069 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.04 

41069 

A 

1 

42 

71 

0.83 

0.19 

1.11 

0.41 

41069 

B 

0 

6 

10 

-0.74 

0.51 

0.63 

-0.33 

41069 

C 

0 

7 

12 

0.29 

0.28 

1.26 

-0.06 

41069 

D 

0 

4 

7 

-0.82 

0.51 

0.49 

-0.28 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41070 

* 

-1 

4821 

99 

1.00 

0.02 

0.00 

0.03 

41070 

A 

1 

50 

79 

0.91 

0.17 

1.15 

0.35 

41070 

B 

0 

3 

5 

-0.62 

0.31 

0.41 

-0.25 

41070 

C 

0 

5 

8 

-0.22 

0.33 

0.71 

-0.23 

41070 

D 

0 

5 

8 

0.34 

0.48 

1.47 

-0.09 

41071 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.01 

41071 

A 

1 

43 

84 

1.21 

0.18 

0.79 

0.51 

41071 

B 

0 

3 

6 

0.14 

0.21 

0.78 

-0.14 

41071 

C 

0 

2 

4 

-1.54 

1.55 

0.34 

-0.37 

41071 

D 

0 

3 

6 

-0.96 

0.45 

0.31 

-0.35 

41072 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

41072 

A 

1 

43 

80 

0.87 

0.16 

0.97 

0.37 

41072 

B 

0 

6 

11 

-0.17 

0.30 

0.71 

-0.29 

41072 

C 

0 

3 

6 

0.35 

0.61 

1.33 

-0.07 

41072 

D 

0 

2 

4 

-0.48 

0.18 

0.43 

-0.22 

41073 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.02 

41073 

A 

1 

51 

82 

0.93 

0.13 

0.89 

0.44 

41073 

B 

0 

8 

13 

-0.29 

0.26 

0.64 

-0.37 

41073 

C 

0 

1 

2 

1.96 

0.00 

4.78 

0.15 

41073 

D 

0 

2 

3 

-1.36 

0.82 

0.23 

-0.36 

41074 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.01 

41074 

A 

1 

46 

82 

0.99 

0.16 

0.98 

0.32 

41074 

B 

0 

4 

7 

-0.09 

0.45 

0.68 

-0.24 

41074 

C 

0 

5 

9 

0.12 

0.43 

0.88 

-0.21 

41074 

D 

0 

1 

2 

0.65 

0.00 

1.12 

-0.02 

41075 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

41075 

A 

1 

39 

72 

1.22 

0.15 

0.89 

0.46 

41075 

B 

0 

5 

9 

0.06 

0.33 

0.63 

-0.28 

41075 

C 

0 

5 

9 

0.61 

0.31 

1.01 

-0.10 

41075 

D 

0 

5 

9 

-0.14 

0.55 

0.64 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41076 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.05 

41076 

A 

1 

44 

76 

0.82 

0.15 

0.91 

0.54 

41076 

B 

0 

4 

7 

0.11 

0.54 

1.30 

-0.06 

41076 

C 

0 

1 

2 

-0.36 

0.00 

0.56 

-0.08 

41076 

D 

0 

9 

16 

-1.37 

0.58 

0.45 

-0.57 

41077 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

41077 

A 

1 

31 

56 

1.18 

0.18 

1.03 

0.40 

41077 

B 

0 

15 

27 

0.44 

0.21 

0.97 

-0.21 

41077 

C 

0 

2 

4 

1.49 

0.10 

2.11 

0.12 

41077 

D 

0 

7 

13 

-0.24 

0.45 

0.59 

-0.38 

41078 

* 

-1 

4811 

99 

1.00 

0.02 

0.00 

0.03 

41078 

A 

1 

32 

44 

1.56 

0.16 

0.62 

0.67 

41078 

B 

0 

18 

25 

0.04 

0.23 

0.77 

-0.30 

41078 

C 

0 

4 

5 

-0.08 

0.22 

0.48 

-0.15 

41078 

D 

0 

19 

26 

-0.11 

0.20 

0.64 

-0.39 

41079 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.04 

41079 

A 

1 

41 

66 

1.04 

0.19 

0.88 

0.55 

41079 

B 

0 

3 

5 

-1.00 

0.12 

0.29 

-0.25 

41079 

C 

0 

14 

23 

-0.41 

0.27 

0.83 

-0.36 

41079 

D 

0 

4 

6 

-0.76 

0.65 

0.61 

-0.24 

41080 

* 

-1 

4814 

99 

1.00 

0.02 

0.00 

0.02 

41080 

A 

1 

40 

57 

1.32 

0.19 

0.92 

0.47 

41080 

B 

0 

5 

7 

0.06 

0.67 

1.58 

-0.16 

41080 

C 

0 

9 

13 

0.66 

0.17 

1.08 

-0.04 

41080 

D 

0 

16 

23 

-0.15 

0.27 

0.66 

-0.41 

41081 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.01 

41081 

A 

1 

33 

63 

1.27 

0.24 

1.07 

0.40 

41081 

B 

0 

5 

10 

-0.18 

0.48 

0.63 

-0.27 

41081 

C 

0 

8 

15 

0.18 

0.35 

0.95 

-0.23 

41081 

D 

0 

6 

12 

0.54 

0.12 

0.93 

-0.10 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41082 

* 

-1 

4829 

99 

1.01 

0.02 

0.00 

0.05 

41082 

A 

1 

12 

22 

1.08 

0.38 

1.96 

0.32 

41082 

B 

0 

14 

25 

0.44 

0.36 

2.24 

0.03 

41082 

C 

0 

11 

20 

0.31 

0.25 

0.89 

-0.03 

41082 

D 

0 

18 

33 

-0.10 

0.22 

0.66 

-0.28 

41083 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

41083 

A 

1 

22 

40 

1.25 

0.22 

0.98 

0.39 

41083 

B 

0 

19 

35 

0.62 

0.23 

1.45 

0.01 

41083 

C 

0 

6 

11 

0.50 

0.22 

0.84 

-0.03 

41083 

D 

0 

8 

15 

-1.16 

0.72 

0.37 

-0.53 

41084 

* 

-1 

4622 

95 

0.98 

0.02 

0.00 

-0.05 

41084 

A 

1 

85 

32 

1.86 

0.11 

0.99 

0.40 

41084 

B 

0 

93 

35 

1.16 

0.09 

1.20 

-0.07 

41084 

C 

0 

66 

25 

0.88 

0.11 

0.85 

-0.21 

41084 

D 

0 

18 

7 

0.27 

0.21 

0.46 

-0.26 

41085 

* 

-1 

4822 

99 

1.00 

0.02 

0.00 

0.02 

41085 

A 

1 

38 

61 

1.24 

0.18 

1.03 

0.46 

41085 

B 

0 

3 

5 

0.75 

0.29 

1.22 

-0.01 

41085 

C 

0 

12 

19 

0.11 

0.41 

1.82 

-0.27 

41085 

D 

0 

9 

15 

-0.21 

0.19 

0.49 

-0.33 

41086 

* 

-1 

1842 

38 

1.36 

0.03 

0.00 

0.22 

41086 

A 

1 

1007 

33 

1.47 

0.04 

1.36 

0.37 

41086 

B 

0 

645 

21 

0.67 

0.04 

1.38 

-0.04 

41086 

C 

0 

623 

20 

0.45 

0.04 

1.06 

-0.13 

41086 

D 

0 

767 

25 

0.23 

0.04 

0.86 

-0.24 

41087 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

41087 

A 

1 

33 

59 

0.94 

0.18 

1.17 

0.30 

41087 

B 

0 

11 

20 

0.59 

0.43 

2.22 

-0.03 

41087 

C 

0 

8 

14 

0.23 

0.27 

0.87 

-0.16 

41087 

D 

0 

4 

7 

-0.57 

0.40 

0.40 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41088 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

41088 

A 

1 

13 

24 

1.91 

0.39 

1.31 

0.45 

41088 

B 

0 

11 

20 

0.79 

0.30 

0.95 

-0.07 

41088 

C 

0 

15 

27 

0.36 

0.25 

0.63 

-0.30 

41088 

D 

0 

16 

29 

0.82 

0.23 

0.90 

-0.07 

41089 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.02 

41089 

A 

1 

49 

84 

0.93 

0.16 

0.98 

0.36 

41089 

B 

0 

2 

3 

1.18 

0.46 

2.80 

0.07 

41089 

C 

0 

2 

3 

0.58 

1.72 

4.00 

-0.02 

41089 

D 

0 

5 

9 

-1.35 

0.53 

0.29 

-0.50 

41090 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.01 

41090 

A 

1 

32 

60 

1.45 

0.23 

0.87 

0.52 

41090 

B 

0 

4 

8 

0.26 

0.37 

0.77 

-0.15 

41090 

C 

0 

9 

17 

0.29 

0.25 

0.85 

-0.22 

41090 

D 

0 

8 

15 

-0.22 

0.24 

0.47 

-0.38 

41091 

* 

-1 

4817 

99 

1.00 

0.02 

0.00 

0.01 

41091 

A 

1 

52 

78 

1.22 

0.15 

0.81 

0.53 

41091 

B 

0 

5 

7 

-0.38 

0.31 

0.45 

-0.30 

41091 

C 

0 

4 

6 

-0.58 

0.38 

0.39 

-0.31 

41091 

D 

0 

6 

9 

0.00 

0.25 

0.68 

-0.23 

41092 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

-0.01 

41092 

A 

1 

28 

57 

1.86 

0.31 

0.74 

0.57 

41092 

B 

0 

8 

16 

0.14 

0.26 

0.72 

-0.28 

41092 

C 

0 

7 

14 

-0.12 

0.20 

0.50 

-0.33 

41092 

D 

0 

6 

12 

0.32 

0.12 

0.72 

-0.19 

41093 

* 

-1 

4838 

99 

1.00 

0.02 

0.00 

0.02 

41093 

A 

1 

36 

78 

1.12 

0.17 

0.79 

0.61 

41093 

B 

0 

2 

4 

-0.87 

0.45 

0.31 

-0.29 

41093 

C 

0 

4 

9 

-0.21 

0.32 

0.64 

-0.25 

41093 

D 

0 

4 

9 

-0.93 

0.28 

0.30 

-0.43 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


409 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41094 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.04 

41094 

A 

1 

20 

38 

0.98 

0.24 

1.26 

0.34 

41094 

B 

0 

8 

15 

0.73 

0.45 

2.45 

0.09 

41094 

C 

0 

12 

23 

0.04 

0.31 

0.84 

-0.21 

41094 

D 

0 

13 

25 

0.00 

0.27 

0.80 

-0.25 

41095 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.01 

41095 

A 

1 

37 

76 

1.29 

0.18 

0.71 

0.56 

41095 

B 

0 

4 

8 

-0.12 

0.66 

0.96 

-0.24 

41095 

C 

0 

1 

2 

0.73 

0.00 

1.19 

-0.02 

41095 

D 

0 

7 

14 

-0.63 

0.21 

0.36 

-0.49 

41096 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.05 

41096 

A 

1 

33 

59 

0.65 

0.19 

1.48 

0.30 

41096 

B 

0 

10 

18 

0.14 

0.15 

0.90 

-0.12 

41096 

C 

0 

2 

4 

0.24 

0.35 

0.95 

-0.03 

41096 

D 

0 

11 

20 

-0.07 

0.30 

0.94 

-0.24 

41097 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

41097 

A 

1 

36 

65 

1.38 

0.21 

0.77 

0.62 

41097 

B 

0 

4 

7 

-0.59 

0.22 

0.37 

-0.22 

41097 

C 

0 

5 

9 

-0.07 

0.29 

0.68 

-0.14 

41097 

D 

0 

10 

18 

-1.10 

0.56 

0.49 

-0.52 

41098 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

41098 

A 

1 

21 

39 

1.86 

0.31 

0.89 

0.56 

41098 

B 

0 

3 

6 

0.31 

0.65 

0.77 

-0.08 

41098 

C 

0 

14 

26 

0.45 

0.26 

0.81 

-0.15 

41098 

D 

0 

16 

30 

-0.13 

0.32 

0.59 

-0.41 

41099 

* 

-1 

4818 

99 

1.00 

0.02 

0.00 

-0.02 

41099 

A 

1 

51 

77 

1.47 

0.13 

0.84 

0.52 

41099 

B 

0 

7 

11 

0.85 

0.25 

1.10 

-0.11 

41099 

C 

0 

3 

5 

-0.57 

0.32 

0.25 

-0.37 

41099 

D 

0 

5 

8 

-0.33 

0.18 

0.31 

-0.41 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41100 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.01 

41100 

A 

1 

31 

58 

1.13 

0.23 

1.12 

0.28 

41100 

B 

0 

5 

9 

0.03 

0.53 

0.90 

-0.19 

41100 

C 

0 

7 

13 

1.10 

0.46 

2.73 

0.08 

41100 

D 

0 

10 

19 

0.05 

0.45 

1.01 

-0.28 

41151 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

41151 

A 

1 

47 

85 

1.18 

0.22 

1.06 

0.29 

41151 

B 

0 

2 

4 

-0.14 

0.34 

0.60 

-0.16 

41151 

C 

0 

2 

4 

-0.38 

0.01 

0.45 

-0.19 

41151 

D 

0 

4 

7 

0.29 

0.36 

1.05 

-0.14 

41152 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

41152 

A 

1 

46 

84 

1.03 

0.15 

0.92 

0.31 

41152 

B 

0 

4 

7 

1.18 

0.34 

2.28 

0.08 

41152 

C 

0 

2 

4 

0.24 

0.11 

0.76 

-0.11 

41152 

D 

0 

3 

5 

-1.49 

0.45 

0.16 

-0.50 

41153 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.03 

41153 

A 

1 

22 

43 

1.65 

0.29 

0.67 

0.63 

41153 

B 

0 

26 

51 

-0.04 

0.16 

0.74 

-0.46 

41153 

C 

0 

1 

2 

-1.73 

0.00 

0.10 

-0.23 

41153 

D 

0 

2 

4 

-1.09 

1.38 

0.39 

-0.24 

41154 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

41154 

A 

1 

43 

80 

1.06 

0.20 

1.13 

0.33 

41154 

B 

0 

4 

7 

0.19 

0.41 

0.98 

-0.15 

41154 

C 

0 

1 

2 

0.43 

0.00 

0.97 

-0.05 

41154 

D 

0 

6 

11 

-0.12 

0.39 

0.77 

-0.28 

41155 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

41155 

A 

1 

41 

76 

1.10 

0.19 

1.03 

0.40 

41155 

B 

0 

6 

11 

0.06 

0.24 

0.75 

-0.21 

41155 

C 

0 

4 

7 

-0.89 

0.85 

0.65 

-0.38 

41155 

D 

0 

3 

6 

0.69 

0.17 

1.26 

-0.02 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41156 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

41156 

A 

1 

50 

88 

1.06 

0.17 

0.89 

0.46 

41156 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41156 

C 

0 

3 

5 

-1.08 

0.17 

0.26 

-0.35 

41156 

D 

0 

4 

7 

-0.52 

0.25 

0.48 

-0.29 

41157 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

41157 

A 

1 

49 

86 

1.10 

0.15 

0.80 

0.50 

41157 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41157 

C 

0 

2 

4 

0.27 

0.30 

0.87 

-0.10 

41157 

D 

0 

6 

11 

-0.86 

0.49 

0.44 

-0.50 

41158 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

41158 

A 

1 

44 

81 

1.09 

0.20 

0.85 

0.46 

41158 

B 

0 

1 

2 

-0.85 

0.00 

0.33 

-0.16 

41158 

C 

0 

3 

6 

0.18 

0.12 

0.93 

-0.10 

41158 

D 

0 

6 

11 

-0.93 

0.59 

0.64 

-0.42 

41159 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.03 

41159 

A 

1 

46 

85 

0.82 

0.14 

0.89 

0.54 

41159 

B 

0 

3 

6 

-0.97 

0.38 

0.36 

-0.35 

41159 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41159 

D 

0 

5 

9 

-0.71 

0.23 

0.45 

-0.38 

41160 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

41160 

A 

1 

28 

52 

1.24 

0.14 

0.95 

0.39 

41160 

B 

0 

4 

7 

-0.35 

0.51 

0.43 

-0.25 

41160 

C 

0 

10 

19 

0.53 

0.28 

0.91 

-0.09 

41160 

D 

0 

12 

22 

0.23 

0.58 

1.35 

-0.23 

41161 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

41161 

A 

1 

25 

45 

1.06 

0.24 

1.06 

0.28 

41161 

B 

0 

3 

5 

-0.81 

0.34 

0.26 

-0.29 

41161 

C 

0 

4 

7 

0.85 

0.74 

2.09 

0.04 

41161 

D 

0 

23 

42 

0.44 

0.24 

1.96 

-0.17 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


412 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41162 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.01 

41162 

A 

1 

23 

40 

1.05 

0.23 

1.78 

0.17 

41162 

B 

0 

10 

17 

0.48 

0.38 

1.16 

-0.15 

41162 

C 

0 

11 

19 

0.96 

0.35 

1.69 

0.06 

41162 

D 

0 

14 

24 

0.62 

0.23 

1.04 

-0.11 

41163 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

41163 

A 

1 

12 

22 

1.57 

0.29 

1.04 

0.31 

41163 

B 

0 

7 

13 

0.45 

0.54 

0.97 

-0.17 

41163 

C 

0 

11 

20 

0.69 

0.24 

0.78 

-0.11 

41163 

D 

0 

25 

45 

0.85 

0.22 

1.22 

-0.06 

41164 

* 

-1 

4819 

99 

1.00 

0.02 

0.00 

0.01 

41164 

A 

1 

26 

40 

2.02 

0.30 

0.71 

0.60 

41164 

B 

0 

7 

11 

-0.05 

0.45 

0.56 

-0.23 

41164 

C 

0 

8 

12 

-0.08 

0.26 

0.48 

-0.26 

41164 

D 

0 

24 

37 

0.38 

0.19 

0.95 

-0.29 

41165 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.03 

41165 

A 

1 

22 

43 

1.37 

0.22 

0.73 

0.50 

41165 

B 

0 

7 

14 

-0.57 

0.56 

0.53 

-0.38 

41165 

C 

0 

10 

20 

0.61 

0.40 

1.74 

-0.01 

41165 

D 

0 

12 

24 

0.03 

0.23 

0.68 

-0.27 

41166 

* 

-1 

4831 

99 

1.00 

0.02 

0.00 

0.02 

41166 

A 

1 

22 

42 

1.50 

0.30 

0.97 

0.46 

41166 

B 

0 

3 

6 

0.70 

0.71 

1.49 

-0.02 

41166 

C 

0 

15 

28 

0.38 

0.22 

1.09 

-0.20 

41166 

D 

0 

13 

25 

0.10 

0.29 

0.74 

-0.30 

41167 

* 

-1 

4817 

99 

1.00 

0.02 

0.00 

0.03 

41167 

A 

1 

59 

88 

0.83 

0.13 

0.92 

0.41 

41167 

B 

0 

2 

3 

0.77 

0.67 

2.12 

0.02 

41167 

C 

0 

2 

3 

-0.74 

0.11 

0.38 

-0.22 

41167 

D 

0 

4 

6 

-1.21 

0.49 

0.32 

-0.42 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


413 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41168 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.01 

41168 

A 

1 

44 

81 

1.02 

0.15 

0.88 

0.39 

41168 

B 

0 

3 

6 

-0.29 

0.37 

0.51 

-0.24 

41168 

C 

0 

1 

2 

-0.28 

0.00 

0.45 

-0.14 

41168 

D 

0 

6 

11 

0.05 

0.62 

1.11 

-0.25 

41169 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

41169 

A 

1 

31 

56 

0.82 

0.22 

1.79 

0.22 

41169 

B 

0 

8 

15 

0.62 

0.26 

1.33 

0.01 

41169 

C 

0 

5 

9 

-0.20 

0.56 

0.87 

-0.23 

41169 

D 

0 

11 

20 

0.36 

0.20 

1.04 

-0.11 

41170 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.02 

41170 

A 

1 

55 

96 

0.81 

0.13 

0.98 

0.25 

41170 

B 

0 

1 

2 

-0.42 

0.00 

0.44 

-0.16 

41170 

C 

0 

1 

2 

-0.58 

0.00 

0.38 

-0.18 

41170 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41171 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

41171 

A 

1 

21 

38 

1.55 

0.29 

1.11 

0.42 

41171 

B 

0 

5 

9 

1.03 

0.51 

2.18 

0.05 

41171 

C 

0 

6 

11 

0.82 

0.30 

1.08 

0.00 

41171 

D 

0 

23 

42 

0.14 

0.25 

0.79 

-0.44 

41172 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

41172 

A 

1 

27 

49 

1.42 

0.23 

1.10 

0.35 

41172 

B 

0 

9 

16 

0.93 

0.32 

1.53 

-0.04 

41172 

C 

0 

1 

2 

0.81 

0.00 

0.88 

-0.03 

41172 

D 

0 

18 

33 

0.49 

0.20 

0.90 

-0.33 

41173 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.02 

41173 

A 

1 

10 

19 

0.52 

0.41 

3.74 

-0.09 

41173 

B 

0 

30 

58 

0.95 

0.17 

1.40 

0.30 

41173 

C 

0 

4 

8 

0.01 

0.22 

0.41 

-0.20 

41173 

D 

0 

8 

15 

0.35 

0.30 

0.71 

-0.16 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41174 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

41174 

A 

1 

55 

95 

0.80 

0.17 

0.96 

0.34 

41174 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

41174 

C 

0 

2 

3 

-1.27 

0.70 

0.35 

-0.28 

41174 

D 

0 

1 

2 

-1.11 

0.00 

0.33 

-0.18 

41175 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

41175 

A 

1 

23 

42 

1.43 

0.27 

1.12 

0.51 

41175 

B 

0 

14 

25 

0.52 

0.26 

1.18 

-0.07 

41175 

C 

0 

5 

9 

-0.14 

0.39 

0.54 

-0.20 

41175 

D 

0 

13 

24 

-0.19 

0.25 

0.53 

-0.38 

41176 

* 

-1 

4830 

99 

1.00 

0.02 

0.00 

0.02 

41176 

A 

1 

46 

85 

0.97 

0.14 

0.93 

0.40 

41176 

B 

0 

3 

6 

-0.52 

1.07 

0.81 

-0.27 

41176 

C 

0 

3 

6 

0.66 

0.43 

1.60 

-0.02 

41176 

D 

0 

2 

4 

-1.47 

1.05 

0.25 

-0.39 

41177 

* 

-1 

4832 

99 

1.00 

0.02 

0.00 

0.01 

41177 

A 

1 

8 

15 

2.06 

0.66 

1.52 

0.35 

41177 

B 

0 

18 

35 

0.71 

0.38 

2.56 

-0.07 

41177 

C 

0 

11 

21 

0.65 

0.28 

0.74 

-0.07 

41177 

D 

0 

15 

29 

0.49 

0.31 

0.74 

-0.15 

41178 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.03 

41178 

A 

1 

11 

19 

0.88 

0.48 

4.75 

0.08 

41178 

B 

0 

37 

63 

0.88 

0.15 

1.16 

0.21 

41178 

C 

0 

4 

7 

0.78 

0.69 

1.46 

0.02 

41178 

D 

0 

7 

12 

-0.74 

0.53 

0.31 

-0.43 

41179 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.03 

41179 

A 

1 

23 

41 

1.29 

0.18 

0.74 

0.50 

41179 

B 

0 

4 

7 

0.12 

0.31 

0.62 

-0.12 

41179 

C 

0 

22 

39 

0.31 

0.18 

0.89 

-0.21 

41179 

D 

0 

7 

13 

-0.46 

0.70 

0.85 

-0.35 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41180 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

41180 

A 

1 

26 

47 

1.38 

0.26 

1.13 

0.36 

41180 

B 

0 

6 

11 

1.06 

0.61 

2.79 

0.05 

41180 

C 

0 

15 

27 

0.52 

0.30 

1.17 

-0.16 

41180 

D 

0 

8 

15 

-0.27 

0.29 

0.45 

-0.35 

41181 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

41181 

A 

1 

31 

56 

1.20 

0.24 

1.15 

0.49 

41181 

B 

0 

14 

25 

0.38 

0.19 

1.10 

-0.08 

41181 

C 

0 

4 

7 

-0.72 

0.94 

0.65 

-0.25 

41181 

D 

0 

6 

11 

-1.30 

0.37 

0.22 

-0.46 

41182 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

41182 

A 

1 

20 

36 

1.23 

0.23 

0.96 

0.48 

41182 

B 

0 

18 

33 

0.30 

0.15 

0.78 

-0.27 

41182 

C 

0 

6 

11 

0.73 

0.20 

1.10 

0.03 

41182 

D 

0 

11 

20 

0.14 

0.22 

0.69 

-0.28 

41183 

* 

-1 

4827 

99 

1.01 

0.02 

0.00 

0.05 

41183 

A 

1 

27 

47 

0.67 

0.22 

1.42 

0.25 

41183 

B 

0 

10 

18 

-0.09 

0.32 

0.85 

-0.21 

41183 

C 

0 

11 

19 

0.58 

0.23 

1.54 

0.09 

41183 

D 

0 

9 

16 

-0.15 

0.26 

0.72 

-0.23 

41184 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

41184 

A 

1 

46 

84 

1.12 

0.20 

1.08 

0.25 

41184 

B 

0 

5 

9 

0.39 

0.25 

1.02 

-0.14 

41184 

C 

0 

1 

2 

0.25 

0.00 

0.79 

-0.07 

41184 

D 

0 

3 

5 

-0.09 

0.69 

0.91 

-0.19 

41185 

* 

-1 

4826 

99 

1.00 

0.02 

0.00 

0.03 

41185 

A 

1 

38 

66 

1.04 

0.16 

0.88 

0.47 

41185 

B 

0 

4 

7 

-0.06 

0.42 

0.71 

-0.19 

41185 

C 

0 

8 

14 

-0.09 

0.36 

0.78 

-0.28 

41185 

D 

0 

8 

14 

0.07 

0.36 

0.97 

-0.22 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41186 

* 

-1 

4623 

95 

0.98 

0.02 

0.00 

-0.07 

41186 

A 

1 

98 

38 

2.04 

0.12 

0.93 

0.45 

41186 

B 

0 

126 

48 

1.07 

0.08 

1.00 

-0.27 

41186 

C 

0 

29 

11 

0.78 

0.13 

0.64 

-0.19 

41186 

D 

0 

8 

3 

0.64 

0.38 

0.61 

-0.12 

41187 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

41187 

A 

1 

14 

25 

1.47 

0.43 

1.70 

0.28 

41187 

B 

0 

15 

27 

0.63 

0.32 

1.24 

-0.09 

41187 

C 

0 

7 

13 

1.49 

0.55 

2.93 

0.19 

41187 

D 

0 

19 

35 

0.28 

0.20 

0.59 

-0.30 

41188 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.03 

41188 

A 

1 

18 

33 

1.79 

0.50 

2.93 

0.47 

41188 

B 

0 

13 

24 

0.52 

0.20 

1.04 

-0.03 

41188 

C 

0 

3 

5 

0.53 

0.19 

0.82 

-0.01 

41188 

D 

0 

21 

38 

-0.31 

0.32 

0.67 

-0.42 

41189 

* 

-1 

4827 

99 

1.00 

0.02 

0.00 

0.01 

41189 

A 

1 

23 

40 

1.61 

0.23 

0.88 

0.48 

41189 

B 

0 

5 

9 

-0.62 

0.43 

0.31 

-0.40 

41189 

C 

0 

13 

23 

0.48 

0.21 

0.75 

-0.20 

41189 

D 

0 

16 

28 

0.75 

0.27 

1.19 

-0.09 

41190 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.00 

41190 

A 

1 

16 

29 

1.92 

0.27 

0.86 

0.49 

41190 

B 

0 

5 

9 

0.91 

0.39 

0.91 

-0.03 

41190 

C 

0 

9 

16 

0.94 

0.32 

1.14 

-0.03 

41190 

D 

0 

25 

45 

0.50 

0.22 

0.80 

-0.41 

41191 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.02 

41191 

A 

1 

23 

42 

1.48 

0.18 

0.75 

0.54 

41191 

B 

0 

8 

15 

0.62 

0.27 

0.95 

-0.06 

41191 

C 

0 

6 

11 

0.19 

0.25 

0.61 

-0.19 

41191 

D 

0 

18 

33 

0.17 

0.27 

0.83 

-0.40 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41192 

* 

-1 

4833 

99 

1.00 

0.02 

0.00 

0.03 

41192 

A 

1 

11 

22 

1.32 

0.47 

1.70 

0.28 

41192 

B 

0 

8 

16 

0.66 

0.58 

1.94 

0.01 

41192 

C 

0 

4 

8 

0.39 

0.38 

0.68 

-0.06 

41192 

D 

0 

28 

55 

0.40 

0.20 

0.84 

-0.21 

41193 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

41193 

A 

1 

40 

73 

1.22 

0.18 

0.86 

0.46 

41193 

B 

0 

6 

11 

-0.06 

0.36 

0.69 

-0.26 

41193 

C 

0 

6 

11 

-0.51 

0.58 

0.60 

-0.39 

41193 

D 

0 

3 

5 

0.90 

0.27 

1.44 

0.01 

41194 

* 

-1 

4825 

99 

1.00 

0.02 

0.00 

0.04 

41194 

A 

1 

53 

90 

0.78 

0.14 

0.89 

0.52 

41194 

B 

0 

1 

2 

0.91 

0.00 

1.96 

0.04 

41194 

C 

0 

4 

7 

-1.10 

0.20 

0.28 

-0.34 

41194 

D 

0 

1 

2 

-5.54 

0.00 

0.00 

-0.60 

41195 

* 

-1 

4834 

99 

1.00 

0.02 

0.00 

0.03 

41195 

A 

1 

31 

62 

1.02 

0.16 

1.03 

0.47 

41195 

B 

0 

3 

6 

-0.92 

0.39 

0.25 

-0.41 

41195 

C 

0 

12 

24 

0.40 

0.20 

1.04 

-0.15 

41195 

D 

0 

4 

8 

-0.11 

0.48 

0.68 

-0.24 

41196 

* 

-1 

4814 

99 

1.00 

0.02 

0.00 

0.03 

41196 

A 

1 

28 

40 

1.19 

0.23 

1.36 

0.38 

41196 

B 

0 

31 

44 

0.36 

0.16 

0.91 

-0.22 

41196 

C 

0 

5 

7 

0.30 

0.60 

1.36 

-0.08 

41196 

D 

0 

6 

9 

-0.11 

0.57 

0.89 

-0.20 

41197 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

41197 

A 

1 

39 

71 

1.37 

0.20 

0.87 

0.50 

41197 

B 

0 

11 

20 

-0.35 

0.44 

0.99 

-0.45 

41197 

C 

0 

2 

4 

0.32 

0.73 

0.99 

-0.08 

41197 

D 

0 

3 

5 

0.06 

0.42 

0.72 

-0.15 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

41198 

* 

-1 

4829 

99 

1.00 

0.02 

0.00 

0.01 

41198 

A 

1 

48 

87 

1.07 

0.21 

1.07 

0.36 

41198 

B 

0 

4 

7 

-0.53 

0.53 

0.65 

-0.27 

41198 

C 

0 

2 

4 

-0.44 

0.03 

0.49 

-0.18 

41198 

D 

0 

1 

2 

-0.40 

0.00 

0.51 

-0.12 

41199 

* 

-1 

4814 

99 

1.00 

0.02 

0.00 

0.02 

41199 

A 

1 

45 

64 

1.29 

0.14 

0.90 

0.47 

41199 

B 

0 

5 

7 

0.71 

0.60 

1.63 

-0.02 

41199 

C 

0 

10 

14 

0.23 

0.31 

0.92 

-0.16 

41199 

D 

0 

10 

14 

-0.80 

0.68 

0.59 

-0.47 

41200 

* 

-1 

4828 

99 

1.00 

0.02 

0.00 

0.02 

41200 

A 

1 

41 

73 

1.10 

0.20 

0.98 

0.39 

41200 

B 

0 

8 

14 

0.24 

0.32 

1.08 

-0.18 

41200 

C 

0 

3 

5 

0.62 

0.46 

1.36 

-0.03 

41200 

D 

0 

4 

7 

-0.99 

0.41 

0.30 

-0.39 

4G11 

* 

-1 

4654 

95 

0.97 

0.02 

0.00 

-0.11 

4G1 1 

A 

1 

161 

70 

1.84 

0.10 

1.18 

0.28 

4G1 1 

B 

0 

46 

20 

1.06 

0.12 

1.04 

-0.23 

4G11 

C 

0 

23 

10 

1.23 

0.21 

1.58 

-0.11 

4G11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G110 

* 

-1 

4771 

98 

0.98 

0.02 

0.00 

-0.07 

4G110 

A 

1 

95 

84 

1.80 

0.11 

0.94 

0.41 

4G110 

B 

0 

10 

9 

0.11 

0.27 

0.47 

-0.40 

4G110 

C 

0 

8 

7 

0.96 

0.19 

0.83 

-0.15 

4G110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G111 

* 

-1 

4784 

98 

0.99 

0.02 

0.00 

-0.05 

4G111 

A 

1 

35 

35 

2.04 

0.17 

0.90 

0.44 

4G111 

B 

0 

25 

25 

0.71 

0.20 

0.70 

-0.38 

4G111 

C 

0 

40 

40 

1.29 

0.13 

1.16 

-0.09 

4G111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G112 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.06 

4G112 

A 

1 

66 

70 

1.73 

0.12 

1.14 

0.28 

4G112 

B 

0 

14 

15 

0.95 

0.17 

0.79 

-0.27 

4G112 

C 

0 

14 

15 

1.35 

0.20 

1.24 

-0.09 

4G112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G113 

* 

-1 

4773 

98 

0.98 

0.02 

0.00 

-0.08 

4G113 

A 

1 

88 

79 

1.89 

0.11 

0.93 

0.42 

4G113 

B 

0 

8 

7 

0.57 

0.21 

0.50 

-0.29 

4G113 

C 

0 

15 

14 

0.94 

0.19 

0.80 

-0.27 

4G113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G114 

* 

-1 

4762 

98 

0.99 

0.02 

0.00 

-0.04 

4G114 

A 

1 

102 

84 

1.39 

0.09 

1.08 

0.21 

4G114 

B 

0 

14 

11 

0.82 

0.16 

0.92 

-0.20 

4G114 

C 

0 

6 

5 

1.07 

0.36 

1.33 

-0.06 

4G114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G115 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

4G115 

A 

1 

67 

72 

1.28 

0.12 

1.02 

0.31 

4G115 

B 

0 

11 

12 

0.84 

0.24 

1.28 

-0.10 

4G115 

C 

0 

15 

16 

0.46 

0.14 

0.73 

-0.30 

4G115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G116 

* 

-1 

4786 

98 

0.99 

0.02 

0.00 

-0.06 

4G116 

A 

1 

19 

19 

1.66 

0.28 

1.83 

0.08 

4G116 

B 

0 

11 

11 

1.08 

0.24 

0.71 

-0.17 

4G116 

C 

0 

68 

69 

1.53 

0.10 

1.17 

0.05 

4G116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G117 

* 

-1 

4783 

98 

0.99 

0.02 

0.00 

-0.05 

4G117 

A 

1 

88 

87 

1.62 

0.10 

0.92 

0.39 

4G117 

B 

0 

5 

5 

0.14 

0.54 

0.74 

-0.32 

4G117 

C 

0 

8 

8 

0.76 

0.16 

0.71 

-0.22 

4G117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G118 

* 

-1 

4768 

98 

1.00 

0.02 

0.00 

-0.01 

4G118 

A 

1 

75 

65 

1.25 

0.08 

1.00 

0.33 

4G118 

B 

0 

23 

20 

0.81 

0.13 

1.06 

-0.16 

4G118 

C 

0 

18 

16 

0.61 

0.20 

0.97 

-0.25 

4G118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G119 

* 

-1 

4771 

98 

0.99 

0.02 

0.00 

-0.06 

4G119 

A 

1 

82 

73 

1.54 

0.11 

1.33 

0.01 

4G119 

B 

0 

6 

5 

1.48 

0.32 

1.51 

-0.02 

4G119 

C 

0 

25 

22 

1.52 

0.14 

1.57 

-0.01 

4G119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G12 

* 

-1 

4652 

95 

0.97 

0.02 

0.00 

-0.11 

4G12 

A 

1 

185 

80 

1.86 

0.08 

0.98 

0.37 

4G12 

B 

0 

24 

10 

0.86 

0.16 

0.87 

-0.22 

4G12 

C 

0 

23 

10 

0.67 

0.19 

0.80 

-0.27 

4G12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G120 

* 

-1 

4786 

98 

0.99 

0.02 

0.00 

-0.05 

4G120 

A 

1 

79 

81 

1.54 

0.11 

1.02 

0.19 

4G120 

B 

0 

15 

15 

1.12 

0.23 

1.34 

-0.14 

4G120 

C 

0 

4 

4 

0.84 

0.23 

0.77 

-0.13 

4G120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G121 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.10 

4G121 

A 

1 

51 

46 

2.14 

0.14 

1.14 

0.28 

4G121 

B 

0 

31 

28 

1.51 

0.16 

1.22 

-0.23 

4G121 

C 

0 

28 

25 

1.72 

0.15 

1.17 

-0.08 

4G121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G122 

* 

-1 

4777 

98 

0.99 

0.02 

0.00 

-0.03 

4G122 

A 

1 

89 

83 

1.41 

0.10 

0.92 

0.42 

4G122 

B 

0 

4 

4 

-0.25 

0.59 

0.64 

-0.28 

4G122 

C 

0 

14 

13 

0.41 

0.27 

0.92 

-0.31 

4G122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G123 

* 

-1 

4683 

96 

0.97 

0.02 

0.00 

-0.10 

4G123 

A 

1 

177 

88 

1.73 

0.07 

0.98 

0.23 

4G123 

B 

0 

13 

6 

0.72 

0.18 

0.68 

-0.25 

4G123 

C 

0 

11 

5 

1.38 

0.30 

1.65 

-0.06 

4G123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G124 

* 

-1 

4675 

96 

0.99 

0.02 

0.00 

-0.04 

4G124 

A 

1 

48 

23 

1.56 

0.17 

1.58 

0.19 

4G124 

B 

0 

87 

42 

1.13 

0.07 

0.92 

-0.13 

4G124 

C 

0 

74 

35 

1.22 

0.09 

1.07 

-0.03 

4G124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G125 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.08 

4G125 

A 

1 

79 

72 

1.95 

0.12 

1.01 

0.38 

4G125 

B 

0 

20 

18 

1.18 

0.18 

1.07 

-0.23 

4G125 

C 

0 

11 

10 

0.84 

0.24 

0.69 

-0.27 

4G125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G126 

* 

-1 

4756 

97 

0.98 

0.02 

0.00 

-0.07 

4G126 

A 

1 

103 

80 

1.70 

0.13 

1.16 

0.28 

4G126 

B 

0 

18 

14 

0.81 

0.26 

1.31 

-0.22 

4G126 

C 

0 

7 

5 

0.68 

0.32 

0.81 

-0.15 

4G126 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G127 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4G127 

A 

1 

63 

60 

1.99 

0.15 

1.08 

0.34 

4G127 

B 

0 

13 

12 

0.96 

0.18 

0.70 

-0.25 

4G127 

C 

0 

29 

28 

1.34 

0.14 

1.20 

-0.19 

4G127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G128 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4G128 

A 

1 

52 

54 

1.75 

0.13 

0.97 

0.37 

4G128 

B 

0 

25 

26 

1.17 

0.16 

1.18 

-0.14 

4G128 

C 

0 

19 

20 

0.79 

0.25 

1.36 

-0.31 

4G128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G129 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4G129 

A 

1 

53 

58 

1.73 

0.13 

1.19 

0.19 

4G129 

B 

0 

22 

24 

1.24 

0.19 

1.16 

-0.20 

4G129 

C 

0 

17 

18 

1.55 

0.23 

1.59 

-0.01 

4G129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G13 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4G13 

A 

1 

43 

42 

2.24 

0.18 

1.17 

0.42 

4G13 

B 

0 

50 

49 

1.49 

0.09 

0.93 

-0.23 

4G13 

C 

0 

10 

10 

0.78 

0.24 

0.47 

-0.30 

4G13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G130 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

4G130 

A 

1 

115 

95 

1.35 

0.08 

0.96 

0.28 

4G130 

B 

0 

5 

4 

0.29 

0.36 

0.62 

-0.24 

4G130 

C 

0 

1 

1 

-0.01 

0.00 

0.38 

-0.14 

4G130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G131 

* 

-1 

4670 

96 

0.99 

0.02 

0.00 

-0.04 

4G131 

A 

1 

163 

76 

1.40 

0.07 

0.96 

0.38 

4G131 

B 

0 

28 

13 

0.65 

0.13 

0.89 

-0.24 

4G131 

C 

0 

23 

11 

0.54 

0.16 

0.79 

-0.26 

4G131 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G132 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

4G132 

A 

1 

74 

82 

1.25 

0.11 

0.94 

0.35 

4G132 

B 

0 

10 

11 

0.20 

0.22 

0.66 

-0.33 

4G132 

C 

0 

6 

7 

0.63 

0.23 

0.95 

-0.13 

4G132 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G133 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

4G133 

A 

1 

73 

78 

1.63 

0.11 

0.99 

0.26 

4G133 

B 

0 

10 

11 

1.28 

0.27 

1.38 

-0.08 

4G133 

C 

0 

11 

12 

0.83 

0.25 

0.91 

-0.26 

4G133 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G14 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4G14 

A 

1 

46 

51 

1.73 

0.14 

1.16 

0.19 

4G14 

B 

0 

29 

32 

1.56 

0.17 

1.47 

0.01 

4G14 

C 

0 

16 

18 

1.04 

0.15 

0.75 

-0.26 

4G14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G15 

* 

-1 

4773 

98 

1.00 

0.02 

0.00 

-0.01 

4G15 

A 

1 

71 

64 

1.35 

0.08 

0.87 

0.53 

4G15 

B 

0 

26 

23 

0.56 

0.12 

0.79 

-0.35 

4G15 

C 

0 

14 

13 

0.42 

0.14 

0.65 

-0.32 

4G15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G16 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4G16 

A 

1 

85 

77 

1.71 

0.09 

0.98 

0.38 

4G16 

B 

0 

23 

21 

0.92 

0.15 

0.83 

-0.36 

4G16 

C 

0 

2 

2 

0.79 

0.61 

0.69 

-0.11 

4G16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G17 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

4G17 

A 

1 

67 

74 

1.50 

0.13 

1.10 

0.12 

4G17 

B 

0 

6 

7 

1.13 

0.40 

1.52 

-0.08 

4G17 

C 

0 

18 

20 

1.26 

0.19 

1.52 

-0.08 

4G17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G18 

* 

-1 

4785 

98 

0.98 

0.02 

0.00 

-0.10 

4G18 

A 

1 

51 

52 

2.04 

0.14 

1.27 

0.20 

4G18 

B 

0 

27 

27 

1.74 

0.13 

1.15 

-0.08 

4G18 

C 

0 

21 

21 

1.59 

0.19 

1.06 

-0.15 

4G18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G19 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4G19 

A 

1 

51 

49 

1.68 

0.14 

1.09 

0.44 

4G19 

B 

0 

34 

33 

0.80 

0.15 

0.88 

-0.31 

4G19 

C 

0 

19 

18 

0.84 

0.16 

0.83 

-0.19 

4G19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G21 

* 

-1 

4777 

98 

0.98 

0.02 

0.00 

-0.08 

4G21 

A 

1 

82 

77 

1.92 

0.12 

0.92 

0.40 

4G21 

B 

0 

21 

20 

0.99 

0.15 

0.88 

-0.31 

4G21 

C 

0 

4 

4 

0.28 

0.31 

0.38 

-0.25 

4G21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G210 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4G210 

A 

1 

61 

64 

1.72 

0.13 

1.04 

0.41 

4G210 

B 

0 

18 

19 

0.83 

0.17 

0.81 

-0.28 

4G210 

C 

0 

17 

18 

0.92 

0.19 

0.97 

-0.23 

4G210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G211 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4G211 

A 

1 

91 

99 

1.60 

0.10 

0.97 

0.21 

4G211 

B 

0 

1 

1 

-0.30 

0.00 

0.22 

-0.21 

4G211 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G212 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

4G212 

A 

1 

85 

80 

1.81 

0.11 

1.07 

0.17 

4G212 

B 

0 

3 

3 

0.35 

0.27 

0.36 

-0.23 

4G212 

C 

0 

18 

17 

1.54 

0.24 

1.88 

-0.08 

4G212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G213 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

4G213 

A 

1 

89 

74 

1.48 

0.09 

1.02 

0.35 

4G213 

B 

0 

6 

5 

0.62 

0.34 

0.81 

-0.18 

4G213 

C 

0 

26 

21 

0.83 

0.15 

1.05 

-0.28 

4G213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G214 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

4G214 

A 

1 

68 

73 

1.25 

0.12 

1.08 

0.28 

4G214 

B 

0 

10 

11 

0.59 

0.19 

0.84 

-0.19 

4G214 

C 

0 

15 

16 

0.71 

0.14 

0.94 

-0.18 

4G214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G215 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.06 

4G215 

A 

1 

76 

79 

1.66 

0.11 

0.99 

0.32 

4G215 

B 

0 

5 

5 

1.15 

0.19 

0.94 

-0.09 

4G215 

C 

0 

15 

16 

0.86 

0.18 

0.84 

-0.30 

4G215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G216 

* 

-1 

4791 

98 

0.99 

0.02 

0.00 

-0.06 

4G216 

A 

1 

40 

43 

1.85 

0.17 

1.33 

0.29 

4G216 

B 

0 

23 

25 

1.17 

0.16 

0.94 

-0.23 

4G216 

C 

0 

30 

32 

1.42 

0.13 

1.14 

-0.09 

4G216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G217 

* 

-1 

4770 

98 

1.00 

0.02 

0.00 

-0.01 

4G217 

A 

1 

88 

77 

1.17 

0.08 

1.01 

0.32 

4G217 

B 

0 

2 

2 

0.86 

0.06 

0.96 

-0.03 

4G217 

C 

0 

24 

21 

0.58 

0.13 

0.87 

-0.32 

4G217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G218 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4G218 

A 

1 

62 

56 

1.69 

0.12 

1.30 

0.20 

4G218 

B 

0 

6 

5 

1.64 

0.21 

1.28 

0.03 

4G218 

C 

0 

42 

38 

1.29 

0.11 

1.07 

-0.22 

4G218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G219 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.05 

4G219 

A 

1 

80 

87 

1.51 

0.11 

1.00 

0.24 

4G219 

B 

0 

8 

9 

0.86 

0.17 

0.84 

-0.17 

4G219 

C 

0 

4 

4 

0.68 

0.30 

0.73 

-0.16 

4G219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G22 

* 

-1 

4776 

98 

0.98 

0.02 

0.00 

-0.10 

4G22 

A 

1 

62 

57 

2.03 

0.12 

1.19 

0.25 

4G22 

B 

0 

27 

25 

1.60 

0.16 

1.41 

-0.15 

4G22 

C 

0 

19 

18 

1.51 

0.17 

0.98 

-0.16 

4G22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G220 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4G220 

A 

1 

89 

86 

1.39 

0.10 

0.95 

0.36 

4G220 

B 

0 

12 

12 

0.43 

0.28 

0.93 

-0.29 

4G220 

C 

0 

3 

3 

0.05 

0.38 

0.48 

-0.21 

4G220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G221 

* 

-1 

4696 

96 

0.98 

0.02 

0.00 

-0.08 

4G221 

A 

1 

167 

89 

1.60 

0.07 

0.97 

0.31 

4G221 

B 

0 

3 

2 

0.10 

0.40 

0.39 

-0.18 

4G221 

C 

0 

18 

10 

0.71 

0.16 

0.79 

-0.26 

4G221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G222 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.08 

4G222 

A 

1 

101 

92 

1.80 

0.10 

0.96 

0.33 

4G222 

B 

0 

7 

6 

0.64 

0.23 

0.60 

-0.26 

4G222 

C 

0 

2 

2 

0.16 

0.06 

0.32 

-0.20 

4G222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G223 

* 

-1 

4762 

98 

0.98 

0.02 

0.00 

-0.07 

4G223 

A 

1 

73 

60 

1.95 

0.16 

1.16 

0.35 

4G223 

B 

0 

22 

18 

0.94 

0.19 

0.93 

-0.24 

4G223 

C 

0 

27 

22 

1.12 

0.21 

1.39 

-0.19 

4G223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G224 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4G224 

A 

1 

71 

65 

1.94 

0.13 

1.12 

0.31 

4G224 

B 

0 

17 

16 

1.23 

0.22 

1.04 

-0.19 

4G224 

C 

0 

21 

19 

1.27 

0.16 

0.95 

-0.20 

4G224 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G225 

* 

-1 

4764 

98 

0.98 

0.02 

0.00 

-0.07 

4G225 

A 

1 

94 

78 

1.79 

0.13 

1.05 

0.28 

4G225 

B 

0 

13 

11 

0.84 

0.34 

1.23 

-0.21 

4G225 

C 

0 

13 

11 

1.01 

0.23 

1.14 

-0.16 

4G225 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


427 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G226 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4G226 

A 

1 

55 

52 

2.07 

0.16 

1.01 

0.36 

4G226 

B 

0 

5 

5 

0.41 

0.30 

0.38 

-0.26 

4G226 

C 

0 

45 

43 

1.36 

0.12 

1.11 

-0.26 

4G226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G227 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.04 

4G227 

A 

1 

85 

89 

1.55 

0.10 

0.90 

0.40 

4G227 

B 

0 

6 

6 

0.20 

0.38 

0.59 

-0.31 

4G227 

C 

0 

4 

4 

0.29 

0.14 

0.47 

-0.23 

4G227 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G228 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.06 

4G228 

A 

1 

64 

71 

1.91 

0.11 

0.87 

0.51 

4G228 

B 

0 

14 

16 

0.96 

0.17 

0.75 

-0.29 

4G228 

C 

0 

12 

13 

0.70 

0.16 

0.56 

-0.37 

4G228 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G229 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4G229 

A 

1 

88 

85 

1.92 

0.10 

0.89 

0.43 

4G229 

B 

0 

6 

6 

0.71 

0.20 

0.54 

-0.25 

4G229 

C 

0 

9 

9 

0.61 

0.24 

0.57 

-0.34 

4G229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G23 

* 

-1 

4671 

96 

0.97 

0.02 

0.00 

-0.09 

4G23 

A 

1 

192 

90 

1.64 

0.07 

0.95 

0.29 

4G23 

B 

0 

12 

6 

0.64 

0.35 

1.01 

-0.22 

4G23 

C 

0 

9 

4 

0.68 

0.26 

0.77 

-0.18 

4G23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G230 

* 

-1 

4764 

98 

0.99 

0.02 

0.00 

-0.04 

4G230 

A 

1 

38 

32 

1.83 

0.13 

0.95 

0.41 

4G230 

B 

0 

28 

23 

1.03 

0.16 

1.03 

-0.17 

4G230 

C 

0 

54 

45 

1.08 

0.11 

0.92 

-0.24 

4G230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G231 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

4G231 

A 

1 

40 

44 

1.59 

0.13 

0.81 

0.47 

4G231 

B 

0 

37 

41 

0.59 

0.10 

0.71 

-0.44 

4G231 

C 

0 

13 

14 

0.98 

0.36 

2.33 

-0.05 

4G231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G232 

* 

-1 

4675 

96 

0.99 

0.02 

0.00 

-0.04 

4G232 

A 

1 

141 

67 

1.52 

0.07 

0.90 

0.44 

4G232 

B 

0 

52 

25 

0.81 

0.10 

0.95 

-0.30 

4G232 

C 

0 

16 

8 

0.42 

0.20 

0.66 

-0.28 

4G232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G233 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

4G233 

A 

1 

46 

49 

1.96 

0.14 

0.94 

0.49 

4G233 

B 

0 

21 

22 

0.89 

0.14 

0.69 

-0.35 

4G233 

C 

0 

27 

29 

1.19 

0.13 

0.94 

-0.21 

4G233 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G24 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4G24 

A 

1 

67 

74 

1.72 

0.11 

1.04 

0.31 

4G24 

B 

0 

5 

5 

0.65 

0.19 

0.51 

-0.24 

4G24 

C 

0 

19 

21 

1.19 

0.21 

1.76 

-0.21 

4G24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G25 

* 

-1 

4773 

98 

1.00 

0.02 

0.00 

-0.01 

4G25 

A 

1 

64 

58 

1.18 

0.09 

1.13 

0.21 

4G25 

B 

0 

18 

16 

1.05 

0.14 

1.24 

0.00 

4G25 

C 

0 

29 

26 

0.74 

0.15 

1.06 

-0.24 

4G25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G26 

* 

-1 

4695 

96 

0.99 

0.02 

0.00 

-0.05 

4G26 

A 

1 

88 

47 

1.68 

0.11 

1.07 

0.37 

4G26 

B 

0 

58 

31 

0.98 

0.10 

1.07 

-0.23 

4G26 

C 

0 

43 

23 

0.97 

0.12 

1.01 

-0.19 

4G26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G27 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4G27 

A 

1 

83 

75 

1.69 

0.09 

1.00 

0.32 

4G27 

B 

0 

11 

10 

0.98 

0.28 

1.03 

-0.21 

4G27 

C 

0 

16 

15 

1.08 

0.20 

0.99 

-0.21 

4G27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G28 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

4G28 

A 

1 

50 

56 

1.69 

0.15 

1.08 

0.27 

4G28 

B 

0 

16 

18 

1.40 

0.24 

1.74 

-0.02 

4G28 

C 

0 

23 

26 

0.97 

0.12 

0.82 

-0.29 

4G28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G29 

* 

-1 

4789 

98 

0.98 

0.02 

0.00 

-0.09 

4G29 

A 

1 

45 

47 

2.15 

0.13 

1.04 

0.31 

4G29 

B 

0 

4 

4 

0.78 

0.25 

0.37 

-0.25 

4G29 

C 

0 

46 

48 

1.67 

0.13 

1.40 

-0.21 

4G29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G31 

* 

-1 

4777 

98 

0.98 

0.02 

0.00 

-0.08 

4G31 

A 

1 

36 

34 

2.19 

0.22 

1.08 

0.33 

4G31 

B 

0 

66 

62 

1.38 

0.11 

1.11 

-0.34 

4G31 

C 

0 

5 

5 

1.89 

0.41 

1.63 

0.04 

4G31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G310 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4G310 

A 

1 

63 

66 

1.57 

0.13 

1.11 

0.22 

4G310 

B 

0 

21 

22 

1.12 

0.20 

1.41 

-0.15 

4G310 

C 

0 

12 

13 

1.05 

0.32 

1.33 

-0.13 

4G310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G311 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4G311 

A 

1 

51 

55 

1.57 

0.15 

1.42 

-0.01 

4G311 

B 

0 

40 

43 

1.64 

0.12 

1.52 

0.05 

4G311 

C 

0 

1 

1 

-0.30 

0.00 

0.16 

-0.21 

4G311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G312 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

4G312 

A 

1 

80 

75 

1.92 

0.11 

0.97 

0.34 

4G312 

B 

0 

10 

9 

1.27 

0.28 

1.11 

-0.14 

4G312 

C 

0 

16 

15 

1.02 

0.19 

0.81 

-0.29 

4G312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G313 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

4G313 

A 

1 

77 

64 

1.32 

0.10 

1.33 

0.04 

4G313 

B 

0 

38 

31 

1.26 

0.13 

1.46 

-0.03 

4G313 

C 

0 

6 

5 

1.24 

0.48 

1.88 

-0.02 

4G313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G314 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

4G314 

A 

1 

58 

62 

1.16 

0.14 

1.28 

0.09 

4G314 

B 

0 

10 

11 

0.95 

0.23 

1.29 

-0.05 

4G314 

C 

0 

25 

27 

0.99 

0.15 

1.35 

-0.07 

4G314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G315 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.06 

4G315 

A 

1 

63 

66 

1.56 

0.13 

1.25 

0.08 

4G315 

B 

0 

29 

30 

1.37 

0.14 

1.30 

-0.10 

4G315 

C 

0 

4 

4 

1.65 

0.51 

1.87 

0.03 

4G315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G316 

* 

-1 

4791 

98 

0.99 

0.02 

0.00 

-0.06 

4G316 

A 

1 

58 

62 

1.53 

0.13 

1.38 

-0.02 

4G316 

B 

0 

28 

30 

1.39 

0.15 

1.26 

-0.11 

4G316 

C 

0 

7 

8 

2.28 

0.35 

3.36 

0.23 

4G316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G317 

* 

-1 

4770 

98 

1.00 

0.02 

0.00 

-0.01 

4G317 

A 

1 

87 

76 

1.01 

0.08 

1.17 

-0.09 

4G317 

B 

0 

24 

21 

1.36 

0.12 

1.83 

0.22 

4G317 

C 

0 

3 

3 

-0.45 

0.05 

0.26 

-0.33 

4G317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G318 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4G318 

A 

1 

83 

75 

1.73 

0.09 

1.00 

0.39 

4G318 

B 

0 

14 

13 

1.03 

0.16 

0.85 

-0.21 

4G318 

C 

0 

13 

12 

0.82 

0.23 

0.82 

-0.29 

4G318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G319 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.05 

4G319 

A 

1 

75 

82 

1.57 

0.12 

0.97 

0.31 

4G319 

B 

0 

14 

15 

0.74 

0.15 

0.77 

-0.29 

4G319 

C 

0 

3 

3 

0.85 

0.29 

0.80 

-0.10 

4G319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G32 

* 

-1 

4777 

98 

0.98 

0.02 

0.00 

-0.10 

4G32 

A 

1 

73 

68 

2.04 

0.10 

1.00 

0.32 

4G32 

B 

0 

30 

28 

1.51 

0.14 

1.07 

-0.23 

4G32 

C 

0 

4 

4 

0.80 

0.32 

0.47 

-0.23 

4G32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G320 

* 

-1 

4656 

95 

0.97 

0.02 

0.00 

-0.09 

4G320 

A 

1 

224 

98 

1.53 

0.06 

0.95 

0.25 

4G320 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G320 

C 

0 

4 

2 

-0.30 

0.38 

0.31 

-0.25 

4G320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G321 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4G321 

A 

1 

86 

83 

1.41 

0.10 

1.01 

0.37 

4G321 

B 

0 

15 

14 

0.59 

0.19 

0.90 

-0.27 

4G321 

C 

0 

3 

3 

-0.28 

0.36 

0.34 

-0.26 

4G321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G322 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.08 

4G322 

A 

1 

107 

97 

1.72 

0.10 

1.02 

0.11 

4G322 

B 

0 

2 

2 

0.96 

0.00 

0.75 

-0.09 

4G322 

C 

0 

1 

1 

1.09 

0.00 

0.85 

-0.06 

4G322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G323 

* 

-1 

4652 

95 

0.97 

0.02 

0.00 

-0.11 

4G323 

A 

1 

179 

77 

1.90 

0.09 

0.95 

0.41 

4G323 

B 

0 

35 

15 

0.96 

0.13 

0.91 

-0.24 

4G323 

C 

0 

18 

8 

0.37 

0.21 

0.56 

-0.31 

4G323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G324 

* 

-1 

4762 

98 

0.98 

0.02 

0.00 

-0.07 

4G324 

A 

1 

95 

78 

1.86 

0.13 

0.99 

0.40 

4G324 

B 

0 

11 

9 

0.55 

0.26 

0.69 

-0.25 

4G324 

C 

0 

16 

13 

0.68 

0.21 

0.84 

-0.28 

4G324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G325 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4G325 

A 

1 

76 

73 

1.52 

0.11 

0.98 

0.47 

4G325 

B 

0 

12 

12 

0.47 

0.27 

0.83 

-0.28 

4G325 

C 

0 

16 

15 

0.48 

0.16 

0.70 

-0.33 

4G325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G326 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4G326 

A 

1 

94 

86 

1.86 

0.10 

0.91 

0.38 

4G326 

B 

0 

9 

8 

0.64 

0.39 

1.11 

-0.30 

4G326 

C 

0 

6 

6 

0.80 

0.17 

0.62 

-0.20 

4G326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G327 

* 

-1 

4765 

98 

0.98 

0.02 

0.00 

-0.08 

4G327 

A 

1 

90 

76 

1.87 

0.13 

1.04 

0.36 

4G327 

B 

0 

6 

5 

0.14 

0.32 

0.41 

-0.27 

4G327 

C 

0 

23 

19 

0.99 

0.20 

1.40 

-0.24 

4G327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G328 

* 

-1 

4692 

96 

0.98 

0.02 

0.00 

-0.08 

4G328 

A 

1 

108 

56 

1.76 

0.09 

1.04 

0.29 

4G328 

B 

0 

2 

1 

-0.25 

0.55 

0.21 

-0.20 

4G328 

C 

0 

82 

43 

1.26 

0.09 

1.12 

-0.25 

4G328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G329 

* 

-1 

4780 

98 

0.98 

0.02 

0.00 

-0.08 

4G329 

A 

1 

82 

79 

1.77 

0.13 

1.09 

0.16 

4G329 

B 

0 

10 

10 

1.31 

0.21 

1.13 

-0.11 

4G329 

C 

0 

12 

12 

1.36 

0.27 

1.41 

-0.10 

4G329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G33 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

4G33 

A 

1 

40 

43 

1.77 

0.17 

1.11 

0.31 

4G33 

B 

0 

48 

51 

1.17 

0.13 

1.11 

-0.25 

4G33 

C 

0 

6 

6 

1.01 

0.36 

0.87 

-0.11 

4G33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G330 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.06 

4G330 

A 

1 

65 

73 

1.84 

0.12 

0.95 

0.40 

4G330 

B 

0 

17 

19 

1.17 

0.17 

0.98 

-0.22 

4G330 

C 

0 

7 

8 

0.50 

0.17 

0.43 

-0.34 

4G330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G331 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4G331 

A 

1 

78 

76 

1.87 

0.13 

1.17 

0.22 

4G331 

B 

0 

18 

17 

1.37 

0.15 

1.06 

-0.17 

4G331 

C 

0 

7 

7 

1.25 

0.19 

0.86 

-0.13 

4G331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G332 

* 

-1 

4765 

98 

0.99 

0.02 

0.00 

-0.04 

4G332 

A 

1 

43 

36 

1.24 

0.13 

1.61 

-0.06 

4G332 

B 

0 

63 

53 

1.35 

0.11 

1.30 

0.04 

4G332 

C 

0 

13 

11 

1.39 

0.30 

1.64 

0.03 

4G332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G333 

* 

-1 

4679 

96 

0.98 

0.02 

0.00 

-0.08 

4G333 

A 

1 

136 

66 

1.84 

0.08 

0.86 

0.51 

4G333 

B 

0 

36 

18 

0.85 

0.10 

0.72 

-0.32 

4G333 

C 

0 

33 

16 

0.78 

0.12 

0.74 

-0.33 

4G333 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


434 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G334 

* 

-1 

4795 

98 

1.00 

0.02 

0.00 

-0.01 

4G334 

A 

1 

50 

56 

1.33 

0.13 

1.06 

0.28 

4G334 

B 

0 

24 

27 

0.74 

0.17 

1.09 

-0.23 

4G334 

C 

0 

15 

17 

0.88 

0.25 

1.81 

-0.10 

4G334 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G34 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

4G34 

A 

1 

52 

57 

1.64 

0.12 

1.10 

0.17 

4G34 

B 

0 

16 

18 

1.70 

0.30 

3.10 

0.10 

4G34 

C 

0 

23 

25 

1.05 

0.18 

1.06 

-0.28 

4G34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G35 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4G35 

A 

1 

20 

22 

1.93 

0.25 

1.42 

0.22 

4G35 

B 

0 

64 

70 

1.42 

0.10 

1.03 

-0.22 

4G35 

C 

0 

7 

8 

1.68 

0.36 

1.38 

0.04 

4G35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G36 

* 

-1 

4780 

98 

1.00 

0.02 

0.00 

0.00 

4G36 

A 

1 

29 

28 

1.42 

0.12 

0.90 

0.33 

4G36 

B 

0 

38 

37 

1.04 

0.11 

1.12 

0.02 

4G36 

C 

0 

37 

36 

0.69 

0.13 

0.88 

-0.33 

4G36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G37 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4G37 

A 

1 

63 

57 

1.72 

0.11 

1.17 

0.24 

4G37 

B 

0 

42 

38 

1.36 

0.12 

1.25 

-0.15 

4G37 

C 

0 

5 

5 

0.60 

0.47 

0.64 

-0.23 

4G37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4G38 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

4G38 

A 

1 

41 

46 

1.64 

0.17 

1.24 

0.17 

4G38 

B 

0 

9 

10 

0.59 

0.09 

0.46 

-0.29 

4G38 

C 

0 

39 

44 

1.45 

0.14 

1.57 

0.00 

4G38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4G39 

* 

-1 

4795 

98 

0.98 

0.02 

0.00 

-0.09 

4G39 

A 

1 

24 

27 

2.44 

0.24 

1.18 

0.38 

4G39 

B 

0 

59 

66 

1.61 

0.09 

0.86 

-0.40 

4G39 

C 

0 

6 

7 

2.14 

0.28 

1.32 

0.08 

4G39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD11 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4MD11 

A 

1 

32 

29 

2.21 

0.25 

1.17 

0.32 

4MD11 

B 

0 

34 

31 

1.26 

0.15 

0.95 

-0.25 

4MD11 

C 

0 

43 

39 

1.58 

0.12 

1.17 

-0.06 

4MD11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD110 

* 

-1 

4785 

98 

0.99 

0.02 

0.00 

-0.04 

4MD110 

A 

1 

67 

68 

1.74 

0.12 

0.91 

0.47 

4MD110 

B 

0 

19 

19 

0.74 

0.24 

1.07 

-0.31 

4MD110 

C 

0 

13 

13 

0.59 

0.16 

0.61 

-0.30 

4MD110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD12 

* 

-1 

4791 

98 

0.99 

0.02 

0.00 

-0.06 

4MD12 

A 

1 

26 

28 

1.71 

0.23 

1.75 

0.09 

4MD12 

B 

0 

49 

53 

1.56 

0.12 

1.24 

-0.03 

4MD12 

C 

0 

18 

19 

1.46 

0.21 

1.09 

-0.06 

4MD12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD13 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4MD13 

A 

1 

11 

10 

2.30 

0.50 

2.42 

0.20 

4MD13 

B 

0 

86 

79 

1.69 

0.10 

1.07 

0.01 

4MD13 

C 

0 

12 

11 

1.05 

0.30 

0.54 

-0.21 

4MD13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD14 

* 

-1 

4762 

98 

0.99 

0.02 

0.00 

-0.04 

4MD14 

A 

1 

87 

71 

1.51 

0.09 

1.08 

0.35 

4MD14 

B 

0 

23 

19 

0.94 

0.14 

1.06 

-0.20 

4MD14 

C 

0 

12 

10 

0.62 

0.20 

0.75 

-0.26 

4MD14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD15 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

4MD15 

A 

1 

57 

61 

1.37 

0.12 

0.96 

0.37 

4MD15 

B 

0 

34 

37 

0.68 

0.14 

1.07 

-0.33 

4MD15 

C 

0 

2 

2 

0.21 

0.17 

0.47 

-0.14 

4MD15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD16 

* 

-1 

4787 

98 

0.99 

0.02 

0.00 

-0.06 

4MD16 

A 

1 

65 

67 

1.80 

0.12 

0.94 

0.47 

4MD16 

B 

0 

17 

18 

0.89 

0.10 

0.68 

-0.31 

4MD16 

C 

0 

15 

15 

0.86 

0.16 

0.73 

-0.29 

4MD16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD17 

* 

-1 

4784 

98 

0.99 

0.02 

0.00 

-0.06 

4MD17 

A 

1 

40 

40 

1.98 

0.15 

1.04 

0.41 

4MD17 

B 

0 

39 

39 

1.28 

0.12 

0.98 

-0.18 

4MD17 

C 

0 

21 

21 

0.97 

0.19 

0.86 

-0.29 

4MD17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD18 

* 

-1 

4679 

96 

0.98 

0.02 

0.00 

-0.08 

4MD18 

A 

1 

173 

84 

1.64 

0.07 

0.94 

0.37 

4MD18 

B 

0 

5 

2 

0.15 

0.16 

0.36 

-0.23 

4MD18 

C 

0 

27 

13 

0.79 

0.13 

0.81 

-0.29 

4MD18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD19 

* 

-1 

4768 

98 

1.00 

0.02 

0.00 

-0.01 

4MD19 

A 

1 

98 

84 

1.17 

0.08 

0.98 

0.33 

4MD19 

B 

0 

9 

8 

0.40 

0.22 

0.76 

-0.25 

4MD19 

C 

0 

9 

8 

0.55 

0.18 

0.81 

-0.19 

4MD19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD31 

* 

-1 

4772 

98 

0.99 

0.02 

0.00 

-0.06 

4MD31 

A 

1 

48 

43 

2.02 

0.12 

0.90 

0.46 

4MD31 

B 

0 

28 

25 

1.17 

0.16 

0.93 

-0.23 

4MD31 

C 

0 

36 

32 

1.18 

0.13 

0.90 

-0.27 

4MD31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD310 

* 

-1 

4787 

98 

0.99 

0.02 

0.00 

-0.05 

4MD310 

A 

1 

50 

52 

1.95 

0.14 

0.86 

0.51 

4MD310 

B 

0 

14 

14 

0.74 

0.13 

0.60 

-0.30 

4MD310 

C 

0 

33 

34 

1.02 

0.12 

0.95 

-0.32 

4MD310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD32 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.10 

4MD32 

A 

1 

51 

46 

2.11 

0.15 

1.26 

0.25 

4MD32 

B 

0 

39 

35 

1.57 

0.12 

0.95 

-0.23 

4MD32 

C 

0 

20 

18 

1.77 

0.17 

1.20 

-0.04 

4MD32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD33 

* 

-1 

4778 

98 

0.99 

0.02 

0.00 

-0.03 

4MD33 

A 

1 

92 

87 

1.40 

0.09 

0.90 

0.41 

4MD33 

B 

0 

5 

5 

0.21 

0.23 

0.55 

-0.23 

4MD33 

C 

0 

9 

8 

0.20 

0.40 

1.07 

-0.32 

4MD33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD34 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.08 

4MD34 

A 

1 

67 

61 

2.11 

0.12 

0.91 

0.49 

4MD34 

B 

0 

7 

6 

0.85 

0.34 

0.69 

-0.21 

4MD34 

C 

0 

36 

33 

1.10 

0.13 

0.84 

-0.40 

4MD34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD35 

* 

-1 

4761 

97 

0.98 

0.02 

0.00 

-0.07 

4MD35 

A 

1 

75 

61 

2.09 

0.15 

0.93 

0.50 

4MD35 

B 

0 

21 

17 

0.91 

0.21 

0.89 

-0.24 

4MD35 

C 

0 

27 

22 

0.69 

0.13 

0.62 

-0.37 

4MD35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD36 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

4MD36 

A 

1 

67 

63 

2.08 

0.14 

0.84 

0.49 

4MD36 

B 

0 

18 

17 

1.04 

0.16 

0.79 

-0.26 

4MD36 

C 

0 

21 

20 

0.88 

0.15 

0.74 

-0.35 

4MD36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD37 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4MD37 

A 

1 

72 

75 

1.69 

0.11 

0.86 

0.49 

4MD37 

B 

0 

14 

15 

0.56 

0.17 

0.63 

-0.35 

4MD37 

C 

0 

10 

10 

0.54 

0.25 

0.67 

-0.29 

4MD37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD38 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4MD38 

A 

1 

74 

80 

1.77 

0.11 

0.92 

0.41 

4MD38 

B 

0 

9 

10 

0.91 

0.32 

0.99 

-0.23 

4MD38 

C 

0 

9 

10 

0.68 

0.15 

0.57 

-0.31 

4MD38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD39 

* 

-1 

4672 

96 

0.97 

0.02 

0.00 

-0.09 

4MD39 

A 

1 

115 

54 

2.01 

0.09 

0.95 

0.51 

4MD39 

B 

0 

62 

29 

0.93 

0.10 

0.73 

-0.39 

4MD39 

C 

0 

35 

17 

1.09 

0.14 

0.90 

-0.20 

4MD39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD41 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4MD41 

A 

1 

35 

33 

2.45 

0.19 

0.93 

0.50 

4MD41 

B 

0 

40 

38 

1.38 

0.13 

0.88 

-0.26 

4MD41 

C 

0 

30 

29 

1.32 

0.12 

0.74 

-0.25 

4MD41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD410 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

4MD410 

A 

1 

116 

96 

1.34 

0.08 

0.97 

0.22 

4MD410 

B 

0 

3 

2 

0.88 

0.19 

0.95 

-0.08 

4MD410 

C 

0 

2 

2 

-0.40 

0.65 

0.31 

-0.25 

4MD410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD411 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

4MD411 

A 

1 

41 

44 

1.44 

0.17 

1.15 

0.33 

4MD411 

B 

0 

14 

15 

0.55 

0.17 

0.68 

-0.24 

4MD411 

C 

0 

38 

41 

0.92 

0.12 

1.12 

-0.16 

4MD411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD412 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.05 

4MD412 

A 

1 

39 

41 

2.06 

0.15 

0.84 

0.51 

4MD412 

B 

0 

29 

31 

1.19 

0.14 

0.93 

-0.22 

4MD412 

C 

0 

27 

28 

1.01 

0.13 

0.77 

-0.33 

4MD412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD413 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4MD413 

A 

1 

53 

58 

1.82 

0.13 

1.05 

0.34 

4MD413 

B 

0 

25 

27 

1.25 

0.14 

1.00 

-0.21 

4MD413 

C 

0 

13 

14 

1.06 

0.21 

0.89 

-0.22 

4MD413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD414 

* 

-1 

4770 

98 

1.00 

0.02 

0.00 

-0.01 

4MD414 

A 

1 

63 

55 

1.10 

0.10 

1.25 

0.09 

4MD414 

B 

0 

24 

21 

1.00 

0.13 

1.19 

-0.03 

4MD414 

C 

0 

27 

24 

0.94 

0.14 

1.17 

-0.08 

4MD414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD415 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4MD415 

A 

1 

49 

45 

1.78 

0.12 

1.19 

0.25 

4MD415 

B 

0 

24 

22 

1.07 

0.14 

0.78 

-0.28 

4MD415 

C 

0 

37 

34 

1.50 

0.15 

1.43 

-0.02 

4MD415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD416 

* 

-1 

4654 

95 

0.97 

0.02 

0.00 

-0.11 

4MD416 

A 

1 

199 

87 

1.78 

0.08 

0.90 

0.32 

4MD416 

B 

0 

18 

8 

0.61 

0.37 

3.18 

-0.25 

4MD416 

C 

0 

13 

6 

0.68 

0.18 

0.73 

-0.19 

4MD416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD417 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.05 

4MD417 

A 

1 

45 

49 

1.91 

0.16 

0.90 

0.49 

4MD417 

B 

0 

42 

46 

0.98 

0.10 

0.83 

-0.41 

4MD417 

C 

0 

5 

5 

0.67 

0.16 

0.53 

-0.18 

4MD417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD418 

* 

-1 

4777 

98 

0.98 

0.02 

0.00 

-0.10 

4MD418 

A 

1 

59 

55 

2.18 

0.12 

0.97 

0.41 

4MD418 

B 

0 

17 

16 

1.15 

0.15 

0.61 

-0.33 

4MD418 

C 

0 

31 

29 

1.58 

0.14 

1.06 

-0.19 

4MD418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD419 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4MD419 

A 

1 

31 

30 

1.50 

0.19 

1.86 

0.17 

4MD419 

B 

0 

40 

38 

0.92 

0.14 

0.91 

-0.26 

4MD419 

C 

0 

33 

32 

1.39 

0.18 

1.65 

0.10 

4MD419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD42 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.08 

4MD42 

A 

1 

47 

43 

1.90 

0.19 

1.65 

0.17 

4MD42 

B 

0 

38 

35 

1.58 

0.13 

1.19 

-0.08 

4MD42 

C 

0 

25 

23 

1.48 

0.19 

1.14 

-0.11 

4MD42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD420 

* 

-1 

4763 

98 

0.98 

0.02 

0.00 

-0.07 

4MD420 

A 

1 

73 

60 

2.18 

0.14 

0.83 

0.56 

4MD420 

B 

0 

30 

25 

0.76 

0.15 

0.71 

-0.38 

4MD420 

C 

0 

18 

15 

0.65 

0.16 

0.59 

-0.31 

4MD420 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD43 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

4MD43 

A 

1 

36 

34 

2.19 

0.24 

1.25 

0.34 

4MD43 

B 

0 

49 

46 

1.45 

0.12 

1.10 

-0.18 

4MD43 

C 

0 

21 

20 

1.29 

0.13 

0.79 

-0.17 

4MD43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD44 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4MD44 

A 

1 

29 

30 

1.67 

0.27 

2.10 

0.17 

4MD44 

B 

0 

42 

44 

1.32 

0.11 

1.01 

-0.08 

4MD44 

C 

0 

25 

26 

1.25 

0.15 

1.01 

-0.10 

4MD44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD45 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4MD45 

A 

1 

50 

54 

1.90 

0.15 

1.08 

0.37 

4MD45 

B 

0 

13 

14 

1.33 

0.14 

0.90 

-0.11 

4MD45 

C 

0 

29 

32 

1.14 

0.14 

0.89 

-0.32 

4MD45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD46 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4MD46 

A 

1 

90 

86 

1.82 

0.11 

1.07 

0.23 

4MD46 

B 

0 

13 

12 

1.16 

0.16 

0.91 

-0.20 

4MD46 

C 

0 

2 

2 

0.92 

0.19 

0.63 

-0.11 

4MD46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD47 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

4MD47 

A 

1 

111 

92 

1.37 

0.08 

0.93 

0.28 

4MD47 

B 

0 

2 

2 

0.05 

0.47 

0.43 

-0.19 

4MD47 

C 

0 

8 

7 

0.60 

0.48 

1.55 

-0.21 

4MD47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD48 

* 

-1 

4793 

98 

1.00 

0.02 

0.00 

-0.01 

4MD48 

A 

1 

30 

33 

1.79 

0.19 

0.82 

0.52 

4MD48 

B 

0 

20 

22 

0.49 

0.15 

0.67 

-0.33 

4MD48 

C 

0 

41 

45 

0.86 

0.11 

0.90 

-0.22 

4MD48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD49 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.05 

4MD49 

A 

1 

59 

62 

1.68 

0.12 

1.08 

0.26 

4MD49 

B 

0 

16 

17 

1.04 

0.19 

0.96 

-0.22 

4MD49 

C 

0 

20 

21 

1.31 

0.19 

1.34 

-0.10 

4MD49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD51 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4MD51 

A 

1 

39 

43 

1.98 

0.16 

1.01 

0.41 

4MD51 

B 

0 

27 

30 

1.32 

0.13 

0.92 

-0.17 

4MD51 

C 

0 

25 

27 

1.14 

0.15 

0.84 

-0.28 

4MD51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD510 

* 

-1 

4771 

98 

1.00 

0.02 

0.00 

-0.01 

4MD510 

A 

1 

49 

43 

1.39 

0.10 

0.96 

0.40 

4MD510 

B 

0 

39 

35 

0.60 

0.09 

0.71 

-0.43 

4MD510 

C 

0 

25 

22 

1.05 

0.14 

1.18 

0.01 

4MD510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD511 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4MD511 

A 

1 

81 

74 

1.65 

0.10 

1.11 

0.23 

4MD511 

B 

0 

20 

18 

1.27 

0.21 

1.40 

-0.14 

4MD511 

C 

0 

9 

8 

1.03 

0.11 

0.75 

-0.17 

4MD511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD512 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

4MD512 

A 

1 

61 

67 

1.53 

0.14 

1.12 

0.15 

4MD512 

B 

0 

3 

3 

0.92 

0.53 

0.98 

-0.09 

4MD512 

C 

0 

27 

30 

1.25 

0.16 

1.46 

-0.12 

4MD512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD513 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.10 

4MD513 

A 

1 

67 

65 

2.04 

0.11 

1.03 

0.29 

4MD513 

B 

0 

27 

26 

1.59 

0.18 

1.56 

-0.16 

4MD513 

C 

0 

9 

9 

1.11 

0.22 

0.65 

-0.24 

4MD513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD514 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4MD514 

A 

1 

68 

65 

1.46 

0.13 

1.29 

0.30 

4MD514 

B 

0 

15 

14 

0.59 

0.17 

0.73 

-0.27 

4MD514 

C 

0 

21 

20 

1.00 

0.17 

1.24 

-0.12 

4MD514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD515 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4MD515 

A 

1 

82 

75 

1.93 

0.12 

1.02 

0.38 

4MD515 

B 

0 

26 

24 

1.06 

0.12 

0.82 

-0.33 

4MD515 

C 

0 

1 

1 

-0.73 

0.00 

0.11 

-0.22 

4MD515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD516 

* 

-1 

4764 

98 

0.98 

0.02 

0.00 

-0.07 

4MD516 

A 

1 

101 

84 

1.83 

0.12 

0.88 

0.41 

4MD516 

B 

0 

9 

8 

0.08 

0.39 

0.76 

-0.34 

4MD516 

C 

0 

10 

8 

0.70 

0.18 

0.73 

-0.21 

4MD516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD517 

* 

-1 

4696 

96 

0.98 

0.02 

0.00 

-0.08 

4MD517 

A 

1 

140 

74 

1.67 

0.08 

1.05 

0.31 

4MD517 

B 

0 

34 

18 

1.14 

0.12 

1.11 

-0.17 

4MD517 

C 

0 

14 

7 

0.60 

0.18 

0.65 

-0.26 

4MD517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD518 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4MD518 

A 

1 

90 

86 

1.80 

0.12 

1.01 

0.26 

4MD518 

B 

0 

6 

6 

0.87 

0.34 

0.82 

-0.18 

4MD518 

C 

0 

9 

9 

1.07 

0.18 

0.88 

-0.17 

4MD518 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD519 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4MD519 

A 

1 

73 

76 

1.45 

0.11 

1.14 

0.07 

4MD519 

B 

0 

19 

20 

1.35 

0.28 

3.35 

-0.03 

4MD519 

C 

0 

4 

4 

0.95 

0.61 

1.15 

-0.10 

4MD519 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD52 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4MD52 

A 

1 

86 

93 

1.65 

0.10 

0.98 

0.26 

4MD52 

B 

0 

1 

1 

1.01 

0.00 

0.79 

-0.06 

4MD52 

C 

0 

5 

5 

0.56 

0.26 

0.57 

-0.26 

4MD52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD520 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4MD520 

A 

1 

89 

86 

1.91 

0.10 

0.90 

0.41 

4MD520 

B 

0 

13 

13 

0.72 

0.16 

0.57 

-0.37 

4MD520 

C 

0 

1 

1 

-0.16 

0.00 

0.21 

-0.18 

4MD520 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD53 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

4MD53 

A 

1 

100 

83 

1.45 

0.08 

0.93 

0.39 

4MD53 

B 

0 

8 

7 

0.79 

0.31 

1.05 

-0.15 

4MD53 

C 

0 

13 

11 

0.42 

0.21 

0.68 

-0.35 

4MD53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD54 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

4MD54 

A 

1 

67 

74 

1.27 

0.12 

0.97 

0.33 

4MD54 

B 

0 

18 

20 

0.57 

0.17 

0.94 

-0.27 

4MD54 

C 

0 

5 

6 

0.45 

0.35 

0.79 

-0.16 

4MD54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD55 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

4MD55 

A 

1 

26 

28 

1.61 

0.23 

1.71 

0.07 

4MD55 

B 

0 

39 

41 

1.62 

0.13 

1.33 

0.11 

4MD55 

C 

0 

29 

31 

1.24 

0.15 

0.97 

-0.19 

4MD55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD56 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4MD56 

A 

1 

68 

75 

1.79 

0.10 

0.90 

0.45 

4MD56 

B 

0 

13 

14 

0.80 

0.19 

0.69 

-0.34 

4MD56 

C 

0 

10 

11 

0.95 

0.19 

0.76 

-0.24 

4MD56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD57 

* 

-1 

4773 

98 

1.00 

0.02 

0.00 

-0.01 

4MD57 

A 

1 

40 

36 

1.38 

0.11 

0.97 

0.33 

4MD57 

B 

0 

55 

50 

0.93 

0.10 

1.08 

-0.15 

4MD57 

C 

0 

16 

14 

0.60 

0.17 

0.71 

-0.24 

4MD57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD58 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4MD58 

A 

1 

75 

68 

1.77 

0.09 

0.93 

0.40 

4MD58 

B 

0 

28 

25 

1.04 

0.17 

1.01 

-0.32 

4MD58 

C 

0 

7 

6 

0.93 

0.24 

0.72 

-0.18 

4MD58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD59 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

4MD59 

A 

1 

78 

86 

1.58 

0.11 

0.92 

0.36 

4MD59 

B 

0 

12 

13 

0.49 

0.14 

0.60 

-0.37 

4MD59 

C 

0 

1 

1 

1.14 

0.00 

1.01 

-0.03 

4MD59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD61 

* 

-1 

4785 

98 

0.98 

0.02 

0.00 

-0.10 

4MD61 

A 

1 

59 

60 

2.03 

0.12 

1.10 

0.22 

4MD61 

B 

0 

13 

13 

1.47 

0.35 

1.61 

-0.16 

4MD61 

C 

0 

27 

27 

1.69 

0.13 

1.16 

-0.11 

4MD61 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD610 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4MD610 

A 

1 

63 

61 

1.45 

0.12 

1.14 

0.27 

4MD610 

B 

0 

14 

13 

0.88 

0.29 

1.29 

-0.14 

4MD610 

C 

0 

27 

26 

0.93 

0.18 

1.21 

-0.18 

4MD610 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD611 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4MD611 

A 

1 

106 

97 

1.73 

0.10 

1.00 

0.18 

4MD611 

B 

0 

1 

1 

0.96 

0.00 

0.75 

-0.07 

4MD611 

C 

0 

2 

2 

0.34 

0.25 

0.42 

-0.18 

4MD611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD612 

* 

-1 

4764 

98 

0.98 

0.02 

0.00 

-0.07 

4MD612 

A 

1 

114 

95 

1.71 

0.11 

0.89 

0.34 

4MD612 

B 

0 

4 

3 

-0.21 

0.40 

0.36 

-0.27 

4MD612 

C 

0 

2 

2 

-0.45 

0.67 

0.29 

-0.21 

4MD612 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD613 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4MD613 

A 

1 

83 

79 

1.85 

0.12 

0.96 

0.30 

4MD613 

B 

0 

9 

9 

0.97 

0.27 

0.88 

-0.20 

4MD613 

C 

0 

13 

12 

1.10 

0.26 

1.18 

-0.20 

4MD613 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD614 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.04 

4MD614 

A 

1 

78 

82 

1.49 

0.12 

1.10 

0.17 

4MD614 

B 

0 

9 

9 

1.16 

0.25 

1.30 

-0.08 

4MD614 

C 

0 

8 

8 

0.89 

0.36 

1.19 

-0.15 

4MD614 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD615 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.06 

4MD615 

A 

1 

76 

84 

1.71 

0.11 

1.02 

0.28 

4MD615 

B 

0 

9 

10 

0.88 

0.19 

0.72 

-0.25 

4MD615 

C 

0 

5 

6 

1.16 

0.33 

1.03 

-0.11 

4MD615 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD616 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4MD616 

A 

1 

91 

88 

1.84 

0.11 

0.99 

0.27 

4MD616 

B 

0 

4 

4 

0.64 

0.38 

0.58 

-0.21 

4MD616 

C 

0 

8 

8 

1.12 

0.29 

1.02 

-0.17 

4MD616 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD617 

* 

-1 

4764 

98 

0.99 

0.02 

0.00 

-0.04 

4MD617 

A 

1 

67 

56 

1.44 

0.11 

1.27 

0.17 

4MD617 

B 

0 

34 

28 

1.23 

0.14 

1.29 

-0.05 

4MD617 

C 

0 

19 

16 

0.97 

0.16 

0.95 

-0.17 

4MD617 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD618 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

4MD618 

A 

1 

68 

76 

1.26 

0.11 

0.98 

0.31 

4MD618 

B 

0 

14 

16 

0.53 

0.25 

1.24 

-0.25 

4MD618 

C 

0 

8 

9 

0.63 

0.22 

0.91 

-0.15 

4MD618 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD619 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

4MD619 

A 

1 

67 

71 

1.63 

0.12 

1.09 

0.21 

4MD619 

B 

0 

13 

14 

1.05 

0.23 

1.22 

-0.19 

4MD619 

C 

0 

14 

15 

1.31 

0.20 

1.25 

-0.08 

4MD619 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD62 

* 

-1 

4657 

95 

0.97 

0.02 

0.00 

-0.09 

4MD62 

A 

1 

115 

51 

1.70 

0.09 

1.20 

0.21 

4MD62 

B 

0 

72 

32 

1.33 

0.10 

1.24 

-0.12 

4MD62 

C 

0 

40 

18 

1.21 

0.16 

1.43 

-0.14 

4MD62 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD620 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4MD620 

A 

1 

44 

48 

1.75 

0.15 

1.20 

0.21 

4MD620 

B 

0 

15 

16 

1.32 

0.16 

0.97 

-0.12 

4MD620 

C 

0 

32 

35 

1.40 

0.15 

1.21 

-0.13 

4MD620 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD63 

* 

-1 

4773 

98 

1.00 

0.02 

0.00 

-0.01 

4MD63 

A 

1 

75 

68 

1.33 

0.07 

0.84 

0.55 

4MD63 

B 

0 

22 

20 

0.40 

0.13 

0.70 

-0.42 

4MD63 

C 

0 

14 

13 

0.51 

0.18 

0.77 

-0.27 

4MD63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD64 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4MD64 

A 

1 

62 

56 

1.82 

0.10 

0.97 

0.37 

4MD64 

B 

0 

7 

6 

0.58 

0.24 

0.46 

-0.28 

4MD64 

C 

0 

41 

37 

1.26 

0.13 

1.10 

-0.23 

4MD64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD65 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

4MD65 

A 

1 

74 

83 

1.53 

0.12 

1.03 

0.17 

4MD65 

B 

0 

4 

4 

0.97 

0.47 

1.18 

-0.11 

4MD65 

C 

0 

11 

12 

1.12 

0.26 

1.49 

-0.12 

4MD65 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD66 

* 

-1 

4791 

98 

0.98 

0.02 

0.00 

-0.10 

4MD66 

A 

1 

64 

69 

2.07 

0.11 

1.00 

0.32 

4MD66 

B 

0 

15 

16 

1.72 

0.17 

1.24 

-0.08 

4MD66 

C 

0 

14 

15 

1.16 

0.20 

0.76 

-0.34 

4MD66 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD67 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4MD67 

A 

1 

60 

58 

1.45 

0.12 

1.13 

0.24 

4MD67 

B 

0 

28 

27 

1.07 

0.18 

1.39 

-0.10 

4MD67 

C 

0 

16 

15 

0.75 

0.29 

1.19 

-0.21 

4MD67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD68 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4MD68 

A 

1 

78 

72 

1.99 

0.11 

0.92 

0.44 

4MD68 

B 

0 

16 

15 

0.88 

0.17 

0.69 

-0.32 

4MD68 

C 

0 

15 

14 

1.05 

0.24 

0.98 

-0.25 

4MD68 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD69 

* 

-1 

4766 

98 

0.98 

0.02 

0.00 

-0.08 

4MD69 

A 

1 

71 

60 

2.04 

0.15 

1.01 

0.41 

4MD69 

B 

0 

32 

27 

1.20 

0.19 

1.36 

-0.20 

4MD69 

C 

0 

15 

13 

0.52 

0.20 

0.52 

-0.33 

4MD69 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD71 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4MD71 

A 

1 

45 

43 

2.26 

0.18 

0.92 

0.45 

4MD71 

B 

0 

38 

36 

1.34 

0.12 

0.96 

-0.23 

4MD71 

C 

0 

22 

21 

1.10 

0.17 

0.84 

-0.27 

4MD71 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD710 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.04 

4MD710 

A 

1 

51 

54 

1.71 

0.15 

1.13 

0.32 

4MD710 

B 

0 

24 

25 

0.98 

0.16 

0.93 

-0.25 

4MD710 

C 

0 

20 

21 

1.15 

0.21 

1.32 

-0.13 

4MD710 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD711 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.06 

4MD711 

A 

1 

30 

33 

1.68 

0.23 

1.90 

0.06 

4MD711 

B 

0 

41 

46 

1.62 

0.13 

1.29 

0.02 

4MD711 

C 

0 

19 

21 

1.42 

0.15 

0.92 

-0.10 

4MD711 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD712 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4MD712 

A 

1 

63 

61 

2.10 

0.13 

0.95 

0.44 

4MD712 

B 

0 

20 

19 

1.27 

0.20 

1.01 

-0.22 

4MD712 

C 

0 

20 

19 

1.06 

0.14 

0.70 

-0.32 

4MD712 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD713 

* 

-1 

4765 

98 

0.99 

0.02 

0.00 

-0.04 

4MD713 

A 

1 

49 

41 

1.69 

0.13 

1.10 

0.36 

4MD713 

B 

0 

42 

35 

1.11 

0.12 

1.04 

-0.17 

4MD713 

C 

0 

28 

24 

0.96 

0.14 

0.85 

-0.22 

4MD713 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD714 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

4MD714 

A 

1 

37 

41 

1.60 

0.16 

0.93 

0.45 

4MD714 

B 

0 

28 

31 

0.93 

0.16 

1.20 

-0.11 

4MD714 

C 

0 

25 

28 

0.51 

0.11 

0.64 

-0.37 

4MD714 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD715 

* 

-1 

4791 

98 

0.99 

0.02 

0.00 

-0.06 

4MD715 

A 

1 

62 

67 

1.74 

0.12 

0.99 

0.35 

4MD715 

B 

0 

13 

14 

0.82 

0.16 

0.68 

-0.30 

4MD715 

C 

0 

18 

19 

1.20 

0.19 

1.17 

-0.16 

4MD715 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD716 

* 

-1 

4695 

96 

0.99 

0.02 

0.00 

-0.05 

4MD716 

A 

1 

92 

49 

1.55 

0.11 

1.22 

0.25 

4MD716 

B 

0 

39 

21 

0.99 

0.12 

1.03 

-0.17 

4MD716 

C 

0 

58 

31 

1.12 

0.10 

1.14 

-0.13 

4MD716 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD717 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4MD717 

A 

1 

50 

55 

1.86 

0.14 

1.14 

0.38 

4MD717 

B 

0 

31 

34 

1.03 

0.09 

0.70 

-0.42 

4MD717 

C 

0 

10 

11 

1.63 

0.21 

1.40 

0.03 

4MD717 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD718 

* 

-1 

4778 

98 

1.00 

0.02 

0.00 

0.00 

4MD718 

A 

1 

40 

38 

1.11 

0.13 

1.32 

0.09 

4MD718 

B 

0 

36 

34 

0.94 

0.12 

1.10 

-0.08 

4MD718 

C 

0 

30 

28 

1.01 

0.13 

1.16 

-0.01 

4MD718 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD719 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4MD719 

A 

1 

51 

46 

1.78 

0.14 

1.31 

0.26 

4MD719 

B 

0 

31 

28 

1.42 

0.12 

1.14 

-0.08 

4MD719 

C 

0 

28 

25 

1.19 

0.15 

0.95 

-0.22 

4MD719 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD72 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

4MD72 

A 

1 

37 

42 

1.68 

0.20 

1.33 

0.20 

4MD72 

B 

0 

35 

39 

1.36 

0.12 

1.24 

-0.08 

4MD72 

C 

0 

17 

19 

1.14 

0.20 

1.03 

-0.15 

4MD72 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD720 

* 

-1 

4793 

98 

0.98 

0.02 

0.00 

-0.09 

4MD720 

A 

1 

42 

46 

2.20 

0.16 

1.10 

0.34 

4MD720 

B 

0 

35 

38 

1.78 

0.11 

1.13 

-0.08 

4MD720 

C 

0 

14 

15 

1.10 

0.15 

0.53 

-0.36 

4MD720 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD73 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4MD73 

A 

1 

44 

42 

1.27 

0.15 

1.61 

0.03 

4MD73 

B 

0 

42 

40 

1.37 

0.15 

1.60 

0.11 

4MD73 

C 

0 

18 

17 

0.86 

0.23 

1.01 

-0.18 

4MD73 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD74 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4MD74 

A 

1 

59 

54 

1.88 

0.13 

1.31 

0.18 

4MD74 

B 

0 

15 

14 

1.91 

0.41 

4.48 

0.08 

4MD74 

C 

0 

35 

32 

1.31 

0.13 

0.93 

-0.25 

4MD74 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4MD75 

* 

-1 

4767 

98 

0.98 

0.02 

0.00 

-0.08 

4MD75 

A 

1 

39 

33 

2.57 

0.21 

0.87 

0.52 

4MD75 

B 

0 

29 

25 

1.07 

0.20 

0.90 

-0.25 

4MD75 

C 

0 

49 

42 

1.21 

0.13 

0.90 

-0.28 

4MD75 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD76 

* 

-1 

4781 

98 

0.99 

0.02 

0.00 

-0.03 

4MD76 

A 

1 

43 

42 

1.52 

0.15 

1.34 

0.24 

4MD76 

B 

0 

24 

23 

0.89 

0.17 

0.92 

-0.19 

4MD76 

C 

0 

36 

35 

1.13 

0.18 

1.37 

-0.08 

4MD76 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD77 

* 

-1 

4776 

98 

0.98 

0.02 

0.00 

-0.08 

4MD77 

A 

1 

58 

54 

1.91 

0.15 

1.32 

0.23 

4MD77 

B 

0 

16 

15 

1.66 

0.26 

1.91 

-0.01 

4MD77 

C 

0 

34 

31 

1.30 

0.15 

1.07 

-0.24 

4MD77 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD78 

* 

-1 

4768 

98 

0.98 

0.02 

0.00 

-0.08 

4MD78 

A 

1 

53 

46 

1.97 

0.19 

1.40 

0.24 

4MD78 

B 

0 

21 

18 

1.32 

0.30 

1.96 

-0.12 

4MD78 

C 

0 

42 

36 

1.37 

0.15 

1.21 

-0.16 

4MD78 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4MD79 

* 

-1 

4780 

98 

0.98 

0.02 

0.00 

-0.08 

4MD79 

A 

1 

61 

59 

2.02 

0.15 

1.01 

0.37 

4MD79 

B 

0 

25 

24 

1.30 

0.13 

0.99 

-0.19 

4MD79 

C 

0 

18 

17 

1.02 

0.19 

0.82 

-0.27 

4MD79 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT11 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT11 

A 

1 

75 

69 

1.95 

0.13 

0.98 

0.39 

4NBT11 

B 

0 

12 

11 

0.96 

0.18 

0.75 

-0.23 

4NBT11 

C 

0 

22 

20 

1.07 

0.14 

0.85 

-0.27 

4NBT11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT110 

* 

-1 

4785 

98 

0.99 

0.02 

0.00 

-0.04 

4NBT110 

A 

1 

78 

79 

1.62 

0.11 

0.89 

0.41 

4NBT110 

B 

0 

16 

16 

0.45 

0.25 

0.75 

-0.40 

4NBT110 

C 

0 

5 

5 

0.97 

0.39 

1.13 

-0.09 

4NBT110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT111 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT111 

A 

1 

44 

48 

2.04 

0.14 

0.93 

0.46 

4NBT111 

B 

0 

7 

8 

0.54 

0.19 

0.39 

-0.32 

4NBT111 

C 

0 

41 

45 

1.27 

0.11 

0.96 

-0.29 

4NBT111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT112 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT112 

A 

1 

40 

37 

2.43 

0.17 

0.91 

0.55 

4NBT112 

B 

0 

34 

31 

1.34 

0.13 

0.84 

-0.22 

4NBT112 

C 

0 

35 

32 

1.15 

0.12 

0.71 

-0.35 

4NBT112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT113 

* 

-1 

4762 

98 

0.99 

0.02 

0.00 

-0.04 

4NBT113 

A 

1 

78 

64 

1.55 

0.10 

1.03 

0.35 

4NBT113 

B 

0 

34 

28 

0.99 

0.14 

1.14 

-0.23 

4NBT113 

C 

0 

10 

8 

0.59 

0.20 

0.66 

-0.24 

4NBT113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT114 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

4NBT114 

A 

1 

65 

70 

1.28 

0.12 

1.03 

0.31 

4NBT114 

B 

0 

19 

20 

0.37 

0.13 

0.68 

-0.39 

4NBT114 

C 

0 

9 

10 

1.26 

0.21 

1.74 

0.06 

4NBT114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT115 

* 

-1 

4787 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT115 

A 

1 

67 

69 

1.75 

0.10 

0.90 

0.41 

4NBT115 

B 

0 

19 

20 

0.70 

0.20 

1.17 

-0.43 

4NBT115 

C 

0 

11 

11 

1.32 

0.18 

1.14 

-0.07 

4NBT115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT12 

* 

-1 

4784 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT12 

A 

1 

85 

85 

1.65 

0.10 

0.91 

0.40 

4NBT12 

B 

0 

5 

5 

0.37 

0.32 

0.51 

-0.27 

4NBT12 

C 

0 

10 

10 

0.70 

0.28 

0.81 

-0.28 

4NBT12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT13 

* 

-1 

4768 

98 

1.00 

0.02 

0.00 

-0.01 

4NBT13 

A 

1 

46 

40 

1.20 

0.12 

1.27 

0.15 

4NBT13 

B 

0 

49 

42 

0.99 

0.10 

1.11 

-0.08 

4NBT13 

C 

0 

21 

18 

0.92 

0.18 

1.25 

-0.08 

4NBT13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT14 

* 

-1 

4772 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT14 

A 

1 

61 

54 

1.84 

0.11 

0.99 

0.36 

4NBT14 

B 

0 

30 

27 

1.35 

0.15 

1.24 

-0.12 

4NBT14 

C 

0 

21 

19 

0.92 

0.19 

0.81 

-0.33 

4NBT14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT15 

* 

-1 

4556 

93 

0.96 

0.02 

0.00 

-0.12 

4NBT15 

A 

1 

283 

86 

1.71 

0.07 

0.95 

0.32 

4NBT15 

B 

0 

16 

5 

0.62 

0.18 

0.77 

-0.19 

4NBT15 

C 

0 

29 

9 

0.67 

0.21 

1.46 

-0.24 

4NBT15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT16 

* 

-1 

4787 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT16 

A 

1 

72 

74 

1.65 

0.12 

0.97 

0.33 

4NBT16 

B 

0 

17 

18 

0.99 

0.21 

1.26 

-0.22 

4NBT16 

C 

0 

8 

8 

0.69 

0.16 

0.64 

-0.23 

4NBT16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT17 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.10 

4NBT17 

A 

1 

108 

98 

1.88 

0.09 

0.98 

0.17 

4NBT17 

B 

0 

1 

1 

1.41 

0.00 

0.93 

-0.05 

4NBT17 

C 

0 

1 

1 

-0.07 

0.00 

0.21 

-0.20 

4NBT17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT18 

* 

-1 

4778 

98 

0.99 

0.02 

0.00 

-0.03 

4NBT18 

A 

1 

83 

78 

1.47 

0.10 

1.00 

0.45 

4NBT18 

B 

0 

9 

8 

0.06 

0.19 

0.46 

-0.36 

4NBT18 

C 

0 

14 

13 

0.63 

0.17 

0.81 

-0.24 

4NBT18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT19 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT19 

A 

1 

81 

74 

1.93 

0.11 

0.95 

0.37 

4NBT19 

B 

0 

7 

6 

1.66 

0.29 

1.56 

-0.01 

4NBT19 

C 

0 

22 

20 

0.84 

0.18 

0.74 

-0.41 

4NBT19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT21 

* 

-1 

4761 

97 

0.98 

0.02 

0.00 

-0.07 

4NBT21 

A 

1 

113 

92 

1.70 

0.12 

0.91 

0.32 

4NBT21 

B 

0 

7 

6 

0.23 

0.35 

0.61 

-0.26 

4NBT21 

C 

0 

3 

2 

0.20 

0.79 

0.76 

-0.17 

4NBT21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT210 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT210 

A 

1 

92 

87 

1.77 

0.12 

0.98 

0.24 

4NBT210 

B 

0 

11 

10 

0.89 

0.22 

0.82 

-0.24 

4NBT210 

C 

0 

3 

3 

1.27 

0.89 

2.14 

-0.06 

4NBT210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT211 

* 

-1 

4685 

96 

0.97 

0.02 

0.00 

-0.11 

4NBT211 

A 

1 

151 

76 

1.73 

0.08 

1.10 

0.14 

4NBT211 

B 

0 

46 

23 

1.43 

0.15 

1.77 

-0.13 

4NBT211 

C 

0 

2 

1 

0.85 

1.15 

0.98 

-0.08 

4NBT211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT212 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT212 

A 

1 

89 

93 

1.50 

0.10 

0.95 

0.33 

4NBT212 

B 

0 

6 

6 

0.19 

0.30 

0.54 

-0.31 

4NBT212 

C 

0 

1 

1 

0.55 

0.00 

0.61 

-0.09 

4NBT212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT213 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT213 

A 

1 

73 

79 

1.76 

0.11 

0.98 

0.37 

4NBT213 

B 

0 

10 

11 

0.92 

0.19 

0.77 

-0.25 

4NBT213 

C 

0 

9 

10 

0.88 

0.24 

0.78 

-0.24 

4NBT213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT214 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT214 

A 

1 

95 

90 

1.84 

0.10 

0.94 

0.34 

4NBT214 

B 

0 

8 

8 

0.83 

0.19 

0.66 

-0.25 

4NBT214 

C 

0 

2 

2 

-0.17 

0.13 

0.22 

-0.26 

4NBT214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT215 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

4NBT215 

A 

1 

107 

88 

1.41 

0.08 

0.92 

0.36 

4NBT215 

B 

0 

14 

12 

0.42 

0.22 

0.73 

-0.36 

4NBT215 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT22 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

4NBT22 

A 

1 

70 

75 

1.30 

0.11 

0.96 

0.38 

4NBT22 

B 

0 

9 

10 

0.32 

0.27 

0.81 

-0.27 

4NBT22 

C 

0 

14 

15 

0.57 

0.13 

0.81 

-0.23 

4NBT22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT23 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT23 

A 

1 

73 

77 

1.71 

0.10 

0.91 

0.42 

4NBT23 

B 

0 

14 

15 

0.91 

0.20 

0.92 

-0.26 

4NBT23 

C 

0 

8 

8 

0.59 

0.18 

0.56 

-0.30 

4NBT23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT24 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT24 

A 

1 

88 

97 

1.59 

0.09 

0.96 

0.19 

4NBT24 

B 

0 

3 

3 

0.62 

0.73 

0.83 

-0.19 

4NBT24 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT25 

* 

-1 

4770 

98 

1.00 

0.02 

0.00 

-0.01 

4NBT25 

A 

1 

94 

82 

1.21 

0.07 

0.89 

0.49 

4NBT25 

B 

0 

15 

13 

0.28 

0.16 

0.70 

-0.40 

4NBT25 

C 

0 

5 

4 

0.13 

0.29 

0.56 

-0.26 

4NBT25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT26 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT26 

A 

1 

72 

65 

1.74 

0.10 

1.06 

0.32 

4NBT26 

B 

0 

35 

32 

1.11 

0.13 

0.97 

-0.33 

4NBT26 

C 

0 

3 

3 

1.53 

0.40 

1.29 

0.00 

4NBT26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT27 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT27 

A 

1 

87 

95 

1.48 

0.11 

0.96 

0.26 

4NBT27 

B 

0 

3 

3 

0.19 

0.17 

0.42 

-0.23 

4NBT27 

C 

0 

2 

2 

0.58 

0.31 

0.64 

-0.13 

4NBT27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT28 

* 

-1 

4777 

98 

0.98 

0.02 

0.00 

-0.10 

4NBT28 

A 

1 

94 

88 

1.95 

0.09 

0.96 

0.32 

4NBT28 

B 

0 

6 

6 

0.74 

0.32 

0.57 

-0.30 

4NBT28 

C 

0 

7 

7 

1.33 

0.24 

0.95 

-0.15 

4NBT28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT29 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4NBT29 

A 

1 

86 

83 

1.43 

0.10 

0.97 

0.42 

4NBT29 

B 

0 

12 

12 

0.29 

0.23 

0.68 

-0.35 

4NBT29 

C 

0 

6 

6 

0.37 

0.17 

0.60 

-0.22 

4NBT29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT31 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT31 

A 

1 

72 

66 

1.97 

0.12 

1.01 

0.35 

4NBT31 

B 

0 

10 

9 

1.10 

0.24 

0.84 

-0.18 

4NBT31 

C 

0 

27 

25 

1.21 

0.20 

1.45 

-0.27 

4NBT31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT310 

* 

-1 

4763 

98 

0.98 

0.02 

0.00 

-0.07 

4NBT310 

A 

1 

56 

46 

2.32 

0.17 

0.89 

0.53 

4NBT310 

B 

0 

26 

21 

0.65 

0.14 

0.51 

-0.39 

4NBT310 

C 

0 

39 

32 

1.20 

0.15 

1.05 

-0.22 

4NBT310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT311 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT311 

A 

1 

77 

73 

1.93 

0.13 

0.92 

0.39 

4NBT311 

B 

0 

26 

25 

1.04 

0.16 

1.00 

-0.33 

4NBT311 

C 

0 

3 

3 

0.35 

0.16 

0.36 

-0.20 

4NBT311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT312 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT312 

A 

1 

69 

72 

1.69 

0.12 

0.96 

0.45 

4NBT312 

B 

0 

20 

21 

0.69 

0.16 

0.76 

-0.37 

4NBT312 

C 

0 

7 

7 

0.67 

0.20 

0.64 

-0.21 

4NBT312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT313 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT313 

A 

1 

63 

68 

1.92 

0.11 

0.88 

0.52 

4NBT313 

B 

0 

6 

7 

0.34 

0.21 

0.38 

-0.35 

4NBT313 

C 

0 

23 

25 

0.98 

0.11 

0.75 

-0.36 

4NBT313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT314 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT314 

A 

1 

90 

86 

1.88 

0.11 

0.94 

0.38 

4NBT314 

B 

0 

11 

10 

0.73 

0.14 

0.56 

-0.33 

4NBT314 

C 

0 

4 

4 

0.88 

0.54 

0.84 

-0.16 

4NBT314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT315 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

4NBT315 

A 

1 

93 

77 

1.53 

0.08 

0.88 

0.48 

4NBT315 

B 

0 

18 

15 

0.52 

0.15 

0.69 

-0.37 

4NBT315 

C 

0 

10 

8 

0.58 

0.32 

0.96 

-0.25 

4NBT315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT32 

* 

-1 

4793 

98 

1.00 

0.02 

0.00 

-0.01 

4NBT32 

A 

1 

53 

58 

1.43 

0.14 

1.00 

0.43 

4NBT32 

B 

0 

25 

27 

0.62 

0.13 

0.87 

-0.30 

4NBT32 

C 

0 

13 

14 

0.58 

0.13 

0.73 

-0.22 

4NBT32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT33 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT33 

A 

1 

74 

78 

1.69 

0.11 

0.94 

0.40 

4NBT33 

B 

0 

13 

14 

0.85 

0.14 

0.74 

-0.28 

4NBT33 

C 

0 

8 

8 

0.73 

0.27 

0.80 

-0.25 

4NBT33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT34 

* 

-1 

4670 

96 

0.99 

0.02 

0.00 

-0.04 

4NBT34 

A 

1 

131 

61 

1.47 

0.08 

1.03 

0.37 

4NBT34 

B 

0 

33 

15 

1.01 

0.13 

1.18 

-0.09 

4NBT34 

C 

0 

50 

23 

0.65 

0.10 

0.80 

-0.34 

4NBT34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT35 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT35 

A 

1 

74 

81 

1.70 

0.10 

1.00 

0.34 

4NBT35 

B 

0 

14 

15 

1.02 

0.17 

0.89 

-0.26 

4NBT35 

C 

0 

3 

3 

0.45 

0.26 

0.44 

-0.23 

4NBT35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT36 

* 

-1 

4771 

98 

1.00 

0.02 

0.00 

-0.01 

4NBT36 

A 

1 

49 

43 

1.23 

0.10 

1.10 

0.22 

4NBT36 

B 

0 

14 

12 

0.36 

0.16 

0.56 

-0.35 

4NBT36 

C 

0 

50 

44 

1.05 

0.10 

1.23 

0.01 

4NBT36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT37 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT37 

A 

1 

92 

84 

1.66 

0.09 

0.96 

0.32 

4NBT37 

B 

0 

13 

12 

0.78 

0.27 

0.93 

-0.31 

4NBT37 

C 

0 

5 

5 

1.14 

0.27 

0.97 

-0.10 

4NBT37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT38 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT38 

A 

1 

59 

65 

1.68 

0.14 

1.01 

0.35 

4NBT38 

B 

0 

15 

16 

0.93 

0.18 

0.94 

-0.22 

4NBT38 

C 

0 

17 

19 

0.99 

0.15 

0.93 

-0.21 

4NBT38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT39 

* 

-1 

4782 

98 

0.98 

0.02 

0.00 

-0.10 

4NBT39 

A 

1 

82 

80 

2.05 

0.09 

0.88 

0.47 

4NBT39 

B 

0 

8 

8 

1.25 

0.24 

0.87 

-0.19 

4NBT39 

C 

0 

12 

12 

0.77 

0.18 

0.52 

-0.42 

4NBT39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT41 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4NBT41 

A 

1 

77 

74 

1.49 

0.10 

0.95 

0.42 

4NBT41 

B 

0 

12 

12 

0.32 

0.25 

0.68 

-0.33 

4NBT41 

C 

0 

15 

14 

0.71 

0.25 

1.17 

-0.22 

4NBT41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT410 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT410 

A 

1 

100 

92 

1.82 

0.10 

0.91 

0.39 

4NBT410 

B 

0 

6 

6 

0.20 

0.23 

0.38 

-0.34 

4NBT410 

C 

0 

3 

3 

0.59 

0.21 

0.51 

-0.18 

4NBT410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT411 

* 

-1 

4764 

98 

0.98 

0.02 

0.00 

-0.07 

4NBT411 

A 

1 

115 

96 

1.67 

0.12 

0.99 

0.24 

4NBT411 

B 

0 

4 

3 

0.30 

0.35 

0.61 

-0.19 

4NBT411 

C 

0 

1 

1 

-0.41 

0.00 

0.24 

-0.15 

4NBT411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT412 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT412 

A 

1 

70 

67 

1.93 

0.14 

1.01 

0.32 

4NBT412 

B 

0 

19 

18 

1.46 

0.20 

1.48 

-0.10 

4NBT412 

C 

0 

16 

15 

0.85 

0.16 

0.64 

-0.32 

4NBT412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT413 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT413 

A 

1 

89 

93 

1.46 

0.11 

1.01 

0.19 

4NBT413 

B 

0 

4 

4 

0.83 

0.45 

1.10 

-0.12 

4NBT413 

C 

0 

3 

3 

0.56 

0.64 

0.94 

-0.15 

4NBT413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT414 

* 

-1 

4658 

95 

0.98 

0.02 

0.00 

-0.05 

4NBT414 

A 

1 

189 

84 

1.42 

0.06 

0.94 

0.37 

4NBT414 

B 

0 

23 

10 

0.37 

0.12 

0.59 

-0.36 

4NBT414 

C 

0 

14 

6 

0.85 

0.24 

1.23 

-0.13 

4NBT414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT415 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT415 

A 

1 

71 

78 

1.75 

0.11 

0.98 

0.32 

4NBT415 

B 

0 

12 

13 

1.11 

0.25 

1.02 

-0.20 

4NBT415 

C 

0 

8 

9 

0.91 

0.22 

0.75 

-0.23 

4NBT415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT416 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT416 

A 

1 

88 

85 

1.85 

0.11 

1.02 

0.26 

4NBT416 

B 

0 

5 

5 

1.24 

0.21 

0.91 

-0.11 

4NBT416 

C 

0 

10 

10 

1.01 

0.29 

1.06 

-0.23 

4NBT416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT417 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

4NBT417 

A 

1 

81 

67 

1.61 

0.08 

0.85 

0.50 

4NBT417 

B 

0 

16 

13 

1.02 

0.23 

1.29 

-0.12 

4NBT417 

C 

0 

24 

20 

0.44 

0.12 

0.56 

-0.49 

4NBT417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT418 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

4NBT418 

A 

1 

50 

56 

1.38 

0.14 

1.02 

0.35 

4NBT418 

B 

0 

28 

31 

0.83 

0.14 

1.03 

-0.19 

4NBT418 

C 

0 

12 

13 

0.48 

0.21 

0.78 

-0.25 

4NBT418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT419 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT419 

A 

1 

64 

68 

1.83 

0.11 

0.85 

0.52 

4NBT419 

B 

0 

19 

20 

0.94 

0.13 

0.77 

-0.31 

4NBT419 

C 

0 

11 

12 

0.56 

0.18 

0.56 

-0.37 

4NBT419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT42 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT42 

A 

1 

52 

57 

1.92 

0.12 

0.90 

0.47 

4NBT42 

B 

0 

33 

36 

1.12 

0.11 

0.86 

-0.36 

4NBT42 

C 

0 

6 

7 

0.73 

0.36 

0.61 

-0.24 

4NBT42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT420 

* 

-1 

4773 

98 

1.00 

0.02 

0.00 

-0.01 

4NBT420 

A 

1 

74 

67 

1.34 

0.07 

0.82 

0.56 

4NBT420 

B 

0 

20 

18 

0.73 

0.12 

0.91 

-0.20 

4NBT420 

C 

0 

17 

15 

0.12 

0.14 

0.52 

-0.52 

4NBT420 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT43 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT43 

A 

1 

75 

68 

1.76 

0.09 

0.97 

0.37 

4NBT43 

B 

0 

21 

19 

1.24 

0.19 

1.27 

-0.16 

4NBT43 

C 

0 

14 

13 

0.76 

0.23 

0.78 

-0.33 

4NBT43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT44 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT44 

A 

1 

58 

64 

1.77 

0.14 

0.94 

0.45 

4NBT44 

B 

0 

15 

17 

0.74 

0.11 

0.64 

-0.31 

4NBT44 

C 

0 

17 

19 

0.92 

0.13 

0.81 

-0.25 

4NBT44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT45 

* 

-1 

4785 

98 

0.98 

0.02 

0.00 

-0.10 

4NBT45 

A 

1 

73 

74 

2.11 

0.10 

0.88 

0.45 

4NBT45 

B 

0 

13 

13 

1.36 

0.21 

0.93 

-0.21 

4NBT45 

C 

0 

13 

13 

0.98 

0.21 

0.66 

-0.37 

4NBT45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT46 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4NBT46 

A 

1 

101 

97 

1.27 

0.10 

1.01 

0.18 

4NBT46 

B 

0 

3 

3 

0.19 

0.12 

0.56 

-0.18 

4NBT46 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT47 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT47 

A 

1 

81 

74 

1.96 

0.12 

0.97 

0.42 

4NBT47 

B 

0 

9 

8 

0.77 

0.31 

0.71 

-0.26 

4NBT47 

C 

0 

19 

17 

1.02 

0.13 

0.76 

-0.29 

4NBT47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT48 

* 

-1 

4764 

98 

0.98 

0.02 

0.00 

-0.07 

4NBT48 

A 

1 

111 

93 

1.73 

0.12 

0.89 

0.34 

4NBT48 

B 

0 

2 

2 

0.98 

0.63 

1.12 

-0.06 

4NBT48 

C 

0 

7 

6 

-0.14 

0.36 

0.45 

-0.34 

4NBT48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT49 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT49 

A 

1 

97 

92 

1.76 

0.11 

1.00 

0.24 

4NBT49 

B 

0 

3 

3 

0.32 

0.07 

0.38 

-0.21 

4NBT49 

C 

0 

5 

5 

1.04 

0.11 

0.80 

-0.13 

4NBT49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT51 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.04 

4NBT51 

A 

1 

66 

69 

1.76 

0.11 

0.82 

0.53 

4NBT51 

B 

0 

15 

16 

0.65 

0.14 

0.64 

-0.32 

4NBT51 

C 

0 

14 

15 

0.53 

0.23 

0.69 

-0.36 

4NBT51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT510 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT510 

A 

1 

82 

91 

1.68 

0.10 

0.98 

0.29 

4NBT510 

B 

0 

6 

7 

0.86 

0.19 

0.73 

-0.21 

4NBT510 

C 

0 

2 

2 

0.29 

0.59 

0.44 

-0.21 

4NBT510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT511 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT511 

A 

1 

72 

70 

1.98 

0.12 

0.99 

0.36 

4NBT511 

B 

0 

12 

12 

1.14 

0.16 

0.76 

-0.21 

4NBT511 

C 

0 

19 

18 

1.19 

0.22 

1.12 

-0.25 

4NBT511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT512 

* 

-1 

4764 

98 

0.99 

0.02 

0.00 

-0.04 

4NBT512 

A 

1 

41 

34 

1.75 

0.13 

1.02 

0.36 

4NBT512 

B 

0 

60 

50 

1.21 

0.10 

1.09 

-0.11 

4NBT512 

C 

0 

19 

16 

0.65 

0.17 

0.60 

-0.32 

4NBT512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT513 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

4NBT513 

A 

1 

50 

56 

1.42 

0.14 

1.00 

0.38 

4NBT513 

B 

0 

18 

20 

0.50 

0.15 

0.72 

-0.31 

4NBT513 

C 

0 

22 

24 

0.83 

0.16 

1.10 

-0.16 

4NBT513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT514 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT514 

A 

1 

28 

30 

1.88 

0.23 

1.43 

0.27 

4NBT514 

B 

0 

34 

36 

1.29 

0.12 

0.89 

-0.17 

4NBT514 

C 

0 

32 

34 

1.39 

0.14 

1.09 

-0.09 

4NBT514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT515 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT515 

A 

1 

40 

44 

1.96 

0.15 

0.97 

0.40 

4NBT515 

B 

0 

23 

25 

1.16 

0.18 

0.91 

-0.25 

4NBT515 

C 

0 

28 

31 

1.30 

0.13 

0.94 

-0.19 

4NBT515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT52 

* 

-1 

4775 

98 

1.00 

0.02 

0.00 

0.00 

4NBT52 

A 

1 

28 

26 

1.08 

0.15 

1.50 

0.04 

4NBT52 

B 

0 

61 

56 

1.10 

0.08 

1.15 

0.10 

4NBT52 

C 

0 

20 

18 

0.76 

0.20 

1.02 

-0.17 

4NBT52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT53 

* 

-1 

4682 

96 

0.97 

0.02 

0.00 

-0.10 

4NBT53 

A 

1 

135 

67 

1.91 

0.08 

0.99 

0.39 

4NBT53 

B 

0 

42 

21 

1.16 

0.11 

1.04 

-0.26 

4NBT53 

C 

0 

25 

12 

1.03 

0.15 

0.84 

-0.24 

4NBT53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT54 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT54 

A 

1 

78 

71 

1.79 

0.09 

0.94 

0.46 

4NBT54 

B 

0 

12 

11 

1.02 

0.17 

0.80 

-0.20 

4NBT54 

C 

0 

20 

18 

0.81 

0.16 

0.71 

-0.38 

4NBT54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT55 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT55 

A 

1 

46 

52 

1.70 

0.16 

1.14 

0.26 

4NBT55 

B 

0 

21 

24 

1.19 

0.15 

1.06 

-0.15 

4NBT55 

C 

0 

22 

25 

1.19 

0.19 

1.42 

-0.15 

4NBT55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT56 

* 

-1 

4791 

98 

0.98 

0.02 

0.00 

-0.10 

4NBT56 

A 

1 

75 

81 

2.04 

0.10 

0.95 

0.36 

4NBT56 

B 

0 

9 

10 

0.89 

0.22 

0.56 

-0.36 

4NBT56 

C 

0 

9 

10 

1.55 

0.16 

0.99 

-0.12 

4NBT56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT57 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4NBT57 

A 

1 

64 

62 

1.46 

0.11 

1.11 

0.28 

4NBT57 

B 

0 

20 

19 

0.59 

0.21 

0.93 

-0.32 

4NBT57 

C 

0 

20 

19 

1.17 

0.24 

1.70 

-0.03 

4NBT57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT58 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT58 

A 

1 

83 

76 

1.81 

0.12 

1.11 

0.18 

4NBT58 

B 

0 

16 

15 

1.27 

0.29 

1.69 

-0.17 

4NBT58 

C 

0 

10 

9 

1.49 

0.24 

1.32 

-0.06 

4NBT58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT59 

* 

-1 

4767 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT59 

A 

1 

75 

64 

2.06 

0.15 

1.14 

0.46 

4NBT59 

B 

0 

19 

16 

0.82 

0.17 

0.72 

-0.28 

4NBT59 

C 

0 

23 

20 

0.88 

0.16 

0.83 

-0.29 

4NBT59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT61 

* 

-1 

4780 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT61 

A 

1 

50 

48 

2.11 

0.18 

1.02 

0.38 

4NBT61 

B 

0 

25 

24 

1.26 

0.13 

0.92 

-0.21 

4NBT61 

C 

0 

29 

28 

1.28 

0.16 

1.06 

-0.22 

4NBT61 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT610 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.04 

4NBT610 

A 

1 

79 

83 

1.60 

0.11 

0.88 

0.43 

4NBT610 

B 

0 

12 

13 

0.21 

0.23 

0.55 

-0.45 

4NBT610 

C 

0 

4 

4 

1.18 

0.20 

1.12 

-0.05 

4NBT610 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT611 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT611 

A 

1 

61 

69 

1.96 

0.11 

0.82 

0.55 

4NBT611 

B 

0 

10 

11 

0.79 

0.14 

0.57 

-0.30 

4NBT611 

C 

0 

18 

20 

0.85 

0.19 

0.80 

-0.40 

4NBT611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT612 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT612 

A 

1 

85 

83 

1.85 

0.12 

1.09 

0.23 

4NBT612 

B 

0 

1 

1 

1.53 

0.00 

1.10 

-0.02 

4NBT612 

C 

0 

17 

17 

1.20 

0.16 

0.99 

-0.23 

4NBT612 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT613 

* 

-1 

4765 

98 

0.99 

0.02 

0.00 

-0.04 

4NBT613 

A 

1 

70 

59 

1.58 

0.10 

1.09 

0.37 

4NBT613 

B 

0 

39 

33 

1.02 

0.13 

1.10 

-0.23 

4NBT613 

C 

0 

10 

8 

0.57 

0.18 

0.57 

-0.26 

4NBT613 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT614 

* 

-1 

4795 

98 

1.00 

0.02 

0.00 

-0.01 

4NBT614 

A 

1 

65 

73 

1.28 

0.12 

1.00 

0.33 

4NBT614 

B 

0 

6 

7 

0.34 

0.43 

0.95 

-0.21 

4NBT614 

C 

0 

18 

20 

0.66 

0.12 

0.89 

-0.23 

4NBT614 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT615 

* 

-1 

4791 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT615 

A 

1 

45 

48 

1.95 

0.14 

0.96 

0.47 

4NBT615 

B 

0 

21 

23 

0.98 

0.11 

0.68 

-0.31 

4NBT615 

C 

0 

27 

29 

1.17 

0.15 

0.99 

-0.23 

4NBT615 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT616 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT616 

A 

1 

35 

38 

1.81 

0.16 

1.19 

0.23 

4NBT616 

B 

0 

24 

26 

1.30 

0.17 

1.08 

-0.17 

4NBT616 

C 

0 

32 

35 

1.47 

0.15 

1.17 

-0.07 

4NBT616 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT617 

* 

-1 

4778 

98 

1.00 

0.02 

0.00 

0.00 

4NBT617 

A 

1 

46 

43 

1.24 

0.11 

1.12 

0.26 

4NBT617 

B 

0 

26 

25 

0.92 

0.14 

1.08 

-0.07 

4NBT617 

C 

0 

34 

32 

0.80 

0.12 

1.00 

-0.21 

4NBT617 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT618 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT618 

A 

1 

60 

55 

1.96 

0.10 

0.85 

0.53 

4NBT618 

B 

0 

32 

29 

1.07 

0.11 

0.80 

-0.33 

4NBT618 

C 

0 

18 

16 

0.92 

0.20 

0.77 

-0.31 

4NBT618 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT619 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT619 

A 

1 

52 

58 

1.80 

0.15 

0.98 

0.41 

4NBT619 

B 

0 

17 

19 

1.12 

0.12 

0.93 

-0.16 

4NBT619 

C 

0 

20 

22 

0.84 

0.16 

0.90 

-0.33 

4NBT619 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT62 

* 

-1 

4670 

96 

0.98 

0.02 

0.00 

-0.08 

4NBT62 

A 

1 

163 

76 

1.76 

0.07 

0.86 

0.48 

4NBT62 

B 

0 

32 

15 

0.68 

0.14 

0.81 

-0.32 

4NBT62 

C 

0 

19 

9 

0.37 

0.20 

0.63 

-0.33 

4NBT62 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT620 

* 

-1 

4794 

98 

0.98 

0.02 

0.00 

-0.09 

4NBT620 

A 

1 

45 

50 

2.17 

0.15 

1.10 

0.33 

4NBT620 

B 

0 

20 

22 

1.41 

0.16 

0.84 

-0.27 

4NBT620 

C 

0 

25 

28 

1.71 

0.14 

1.11 

-0.11 

4NBT620 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT621 

* 

-1 

4781 

98 

0.99 

0.02 

0.00 

-0.03 

4NBT621 

A 

1 

70 

68 

1.52 

0.11 

1.01 

0.40 

4NBT621 

B 

0 

13 

13 

0.75 

0.21 

0.91 

-0.19 

4NBT621 

C 

0 

20 

19 

0.59 

0.21 

0.88 

-0.32 

4NBT621 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT63 

* 

-1 

4776 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT63 

A 

1 

47 

44 

2.06 

0.17 

1.19 

0.31 

4NBT63 

B 

0 

27 

25 

1.13 

0.18 

0.81 

-0.31 

4NBT63 

C 

0 

34 

31 

1.61 

0.14 

1.29 

-0.04 

4NBT63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT64 

* 

-1 

4767 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT64 

A 

1 

54 

46 

1.95 

0.20 

1.76 

0.24 

4NBT64 

B 

0 

31 

26 

0.89 

0.14 

0.69 

-0.35 

4NBT64 

C 

0 

32 

27 

1.79 

0.18 

2.12 

0.08 

4NBT64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NBT65 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

4NBT65 

A 

1 

47 

50 

1.84 

0.14 

0.93 

0.42 

4NBT65 

B 

0 

23 

24 

0.69 

0.17 

0.67 

-0.41 

4NBT65 

C 

0 

24 

26 

1.29 

0.17 

1.34 

-0.07 

4NBT65 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT66 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.06 

4NBT66 

A 

1 

50 

56 

1.77 

0.15 

1.33 

0.20 

4NBT66 

B 

0 

17 

19 

1.43 

0.18 

1.19 

-0.09 

4NBT66 

C 

0 

22 

25 

1.37 

0.15 

1.05 

-0.14 

4NBT66 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT67 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4NBT67 

A 

1 

66 

64 

2.07 

0.12 

0.89 

0.44 

4NBT67 

B 

0 

14 

14 

0.96 

0.22 

0.77 

-0.30 

4NBT67 

C 

0 

23 

22 

1.24 

0.18 

1.01 

-0.26 

4NBT67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT68 

* 

-1 

4765 

98 

0.99 

0.02 

0.00 

-0.04 

4NBT68 

A 

1 

58 

49 

1.70 

0.11 

1.06 

0.43 

4NBT68 

B 

0 

21 

18 

0.87 

0.13 

0.75 

-0.24 

4NBT68 

C 

0 

40 

34 

0.99 

0.12 

0.95 

-0.26 

4NBT68 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NBT69 

* 

-1 

4795 

98 

1.00 

0.02 

0.00 

-0.01 

4NBT69 

A 

1 

56 

63 

1.35 

0.13 

1.01 

0.35 

4NBT69 

B 

0 

10 

11 

0.72 

0.19 

0.90 

-0.14 

4NBT69 

C 

0 

23 

26 

0.64 

0.16 

0.97 

-0.28 

4NBT69 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF11 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4NF11 

A 

1 

78 

72 

1.90 

0.13 

1.00 

0.34 

4NF11 

B 

0 

14 

13 

0.83 

0.18 

0.68 

-0.29 

4NF11 

C 

0 

17 

16 

1.26 

0.17 

1.08 

-0.16 

4NF11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF110 

* 

-1 

4785 

98 

0.99 

0.02 

0.00 

-0.04 

4NF110 

A 

1 

46 

46 

1.79 

0.17 

1.28 

0.35 

4NF110 

B 

0 

36 

36 

0.97 

0.13 

0.79 

-0.31 

4NF110 

C 

0 

17 

17 

1.23 

0.21 

1.19 

-0.07 

4NF110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF111 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4NF111 

A 

1 

48 

52 

1.84 

0.15 

1.21 

0.28 

4NF111 

B 

0 

31 

34 

1.46 

0.13 

1.25 

-0.09 

4NF111 

C 

0 

13 

14 

0.92 

0.20 

0.66 

-0.28 

4NF111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF112 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4NF112 

A 

1 

81 

74 

1.88 

0.12 

1.06 

0.33 

4NF112 

B 

0 

9 

8 

0.92 

0.24 

0.74 

-0.22 

4NF112 

C 

0 

19 

17 

1.18 

0.17 

1.02 

-0.22 

4NF112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF113 

* 

-1 

4762 

98 

0.99 

0.02 

0.00 

-0.04 

4NF113 

A 

1 

116 

95 

1.35 

0.08 

0.97 

0.19 

4NF113 

B 

0 

2 

2 

0.00 

1.05 

0.61 

-0.19 

4NF113 

C 

0 

4 

3 

0.86 

0.45 

1.13 

-0.09 

4NF113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF114 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

4NF114 

A 

1 

55 

59 

1.47 

0.13 

0.88 

0.49 

4NF114 

B 

0 

25 

27 

0.54 

0.13 

0.77 

-0.36 

4NF114 

C 

0 

13 

14 

0.55 

0.18 

0.78 

-0.23 

4NF114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF115 

* 

-1 

4679 

96 

0.97 

0.02 

0.00 

-0.09 

4NF115 

A 

1 

129 

63 

1.85 

0.10 

1.01 

0.38 

4NF115 

B 

0 

66 

32 

1.06 

0.10 

0.99 

-0.32 

4NF115 

C 

0 

10 

5 

0.82 

0.22 

0.69 

-0.15 

4NF115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF12 

* 

-1 

4787 

98 

0.99 

0.02 

0.00 

-0.06 

4NF12 

A 

1 

51 

53 

1.74 

0.14 

1.12 

0.27 

4NF12 

B 

0 

27 

28 

1.18 

0.13 

0.92 

-0.21 

4NF12 

C 

0 

19 

20 

1.31 

0.22 

1.40 

-0.10 

4NF12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF13 

* 

-1 

4785 

98 

0.99 

0.02 

0.00 

-0.06 

4NF13 

A 

1 

76 

77 

1.72 

0.10 

0.94 

0.39 

4NF13 

B 

0 

12 

12 

0.83 

0.21 

0.78 

-0.28 

4NF13 

C 

0 

11 

11 

0.87 

0.28 

1.13 

-0.24 

4NF13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF14 

* 

-1 

4768 

98 

1.00 

0.02 

0.00 

-0.01 

4NF14 

A 

1 

69 

59 

1.33 

0.09 

0.94 

0.43 

4NF14 

B 

0 

29 

25 

0.57 

0.13 

0.85 

-0.37 

4NF14 

C 

0 

18 

16 

0.80 

0.14 

0.96 

-0.14 

4NF14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF15 

* 

-1 

4772 

98 

0.99 

0.02 

0.00 

-0.06 

4NF15 

A 

1 

60 

54 

1.96 

0.10 

0.84 

0.49 

4NF15 

B 

0 

22 

20 

1.03 

0.18 

0.86 

-0.27 

4NF15 

C 

0 

30 

27 

1.08 

0.15 

0.89 

-0.30 

4NF15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF16 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4NF16 

A 

1 

78 

81 

1.56 

0.12 

1.04 

0.24 

4NF16 

B 

0 

4 

4 

0.80 

0.20 

0.73 

-0.14 

4NF16 

C 

0 

14 

15 

0.99 

0.13 

0.92 

-0.19 

4NF16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF17 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.10 

4NF17 

A 

1 

58 

53 

2.19 

0.13 

1.03 

0.38 

4NF17 

B 

0 

14 

13 

1.78 

0.20 

1.25 

-0.03 

4NF17 

C 

0 

38 

35 

1.37 

0.12 

0.83 

-0.38 

4NF17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


471 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF18 

* 

-1 

4778 

98 

0.99 

0.02 

0.00 

-0.03 

4NF18 

A 

1 

74 

70 

1.48 

0.11 

1.11 

0.37 

4NF18 

B 

0 

23 

22 

0.75 

0.18 

1.01 

-0.26 

4NF18 

C 

0 

9 

8 

0.51 

0.22 

0.73 

-0.23 

4NF18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF19 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.08 

4NF19 

A 

1 

77 

70 

1.98 

0.12 

0.98 

0.40 

4NF19 

B 

0 

14 

13 

0.79 

0.20 

0.62 

-0.33 

4NF19 

C 

0 

19 

17 

1.23 

0.19 

1.12 

-0.20 

4NF19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF21 

* 

-1 

4761 

97 

0.98 

0.02 

0.00 

-0.07 

4NF21 

A 

1 

76 

62 

1.81 

0.16 

1.36 

0.23 

4NF21 

B 

0 

32 

26 

0.96 

0.17 

1.01 

-0.29 

4NF21 

C 

0 

15 

12 

1.76 

0.21 

1.99 

0.05 

4NF21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF210 

* 

-1 

4685 

96 

0.97 

0.02 

0.00 

-0.11 

4NF210 

A 

1 

131 

66 

1.95 

0.09 

0.94 

0.41 

4NF210 

B 

0 

46 

23 

1.07 

0.12 

0.87 

-0.32 

4NF210 

C 

0 

22 

11 

1.12 

0.15 

0.95 

-0.19 

4NF210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF211 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

4NF211 

A 

1 

87 

82 

1.83 

0.12 

0.96 

0.31 

4NF211 

B 

0 

15 

14 

0.85 

0.19 

0.77 

-0.30 

4NF211 

C 

0 

4 

4 

1.18 

0.45 

1.17 

-0.09 

4NF211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF212 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4NF212 

A 

1 

26 

27 

2.24 

0.22 

0.90 

0.50 

4NF212 

B 

0 

26 

27 

0.84 

0.14 

0.59 

-0.35 

4NF212 

C 

0 

44 

46 

1.26 

0.12 

0.96 

-0.14 

4NF212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF213 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4NF213 

A 

1 

64 

70 

1.87 

0.11 

0.89 

0.47 

4NF213 

B 

0 

24 

26 

0.92 

0.15 

0.78 

-0.42 

4NF213 

C 

0 

4 

4 

0.86 

0.32 

0.67 

-0.16 

4NF213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF214 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4NF214 

A 

1 

67 

64 

1.94 

0.13 

1.09 

0.28 

4NF214 

B 

0 

30 

29 

1.31 

0.17 

1.15 

-0.25 

4NF214 

C 

0 

8 

8 

1.43 

0.16 

0.95 

-0.08 

4NF214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF215 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

4NF215 

A 

1 

76 

63 

1.64 

0.09 

0.88 

0.51 

4NF215 

B 

0 

39 

32 

0.67 

0.11 

0.74 

-0.50 

4NF215 

C 

0 

6 

5 

1.05 

0.40 

1.23 

-0.06 

4NF215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF22 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

4NF22 

A 

1 

39 

42 

1.64 

0.13 

0.77 

0.50 

4NF22 

B 

0 

30 

32 

0.63 

0.16 

1.13 

-0.34 

4NF22 

C 

0 

24 

26 

0.78 

0.15 

0.99 

-0.20 

4NF22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF23 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.05 

4NF23 

A 

1 

23 

24 

1.58 

0.18 

1.50 

0.05 

4NF23 

B 

0 

47 

49 

1.46 

0.16 

1.60 

-0.04 

4NF23 

C 

0 

25 

26 

1.49 

0.13 

1.02 

-0.01 

4NF23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF24 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4NF24 

A 

1 

50 

55 

1.78 

0.12 

1.03 

0.28 

4NF24 

B 

0 

21 

23 

1.49 

0.19 

1.50 

-0.04 

4NF24 

C 

0 

20 

22 

1.06 

0.20 

0.97 

-0.29 

4NF24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF25 

* 

-1 

4770 

98 

1.00 

0.02 

0.00 

-0.01 

4NF25 

A 

1 

90 

79 

1.20 

0.07 

0.92 

0.41 

4NF25 

B 

0 

8 

7 

0.55 

0.23 

0.89 

-0.18 

4NF25 

C 

0 

16 

14 

0.40 

0.19 

0.78 

-0.35 

4NF25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF26 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4NF26 

A 

1 

78 

71 

1.74 

0.10 

1.02 

0.36 

4NF26 

B 

0 

9 

8 

0.71 

0.21 

0.58 

-0.28 

4NF26 

C 

0 

23 

21 

1.16 

0.15 

1.01 

-0.22 

4NF26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF27 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.05 

4NF27 

A 

1 

73 

79 

1.54 

0.12 

1.02 

0.24 

4NF27 

B 

0 

8 

9 

0.96 

0.28 

1.13 

-0.14 

4NF27 

C 

0 

11 

12 

0.95 

0.18 

0.95 

-0.18 

4NF27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF28 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.10 

4NF28 

A 

1 

67 

63 

2.10 

0.11 

1.00 

0.37 

4NF28 

B 

0 

16 

15 

1.24 

0.19 

0.78 

-0.28 

4NF28 

C 

0 

23 

22 

1.51 

0.15 

0.99 

-0.19 

4NF28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF29 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4NF29 

A 

1 

75 

72 

1.61 

0.10 

0.81 

0.59 

4NF29 

B 

0 

8 

8 

0.15 

0.29 

0.54 

-0.32 

4NF29 

C 

0 

21 

20 

0.35 

0.15 

0.62 

-0.45 

4NF29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF31 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4NF31 

A 

1 

40 

37 

2.26 

0.18 

1.10 

0.40 

4NF31 

B 

0 

56 

51 

1.49 

0.12 

1.07 

-0.20 

4NF31 

C 

0 

13 

12 

0.87 

0.20 

0.52 

-0.29 

4NF31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF310 

* 

-1 

4763 

98 

0.98 

0.02 

0.00 

-0.07 

4NF310 

A 

1 

81 

67 

2.10 

0.13 

0.82 

0.57 

4NF310 

B 

0 

24 

20 

0.64 

0.12 

0.58 

-0.38 

4NF310 

C 

0 

16 

13 

0.49 

0.22 

0.58 

-0.34 

4NF310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF311 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4NF311 

A 

1 

67 

64 

1.97 

0.14 

1.04 

0.34 

4NF311 

B 

0 

19 

18 

1.45 

0.18 

1.24 

-0.10 

4NF311 

C 

0 

19 

18 

0.90 

0.14 

0.67 

-0.33 

4NF311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF312 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4NF312 

A 

1 

34 

35 

2.10 

0.18 

0.90 

0.51 

4NF312 

B 

0 

44 

46 

1.03 

0.12 

0.90 

-0.35 

4NF312 

C 

0 

18 

19 

1.03 

0.14 

0.72 

-0.18 

4NF312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF313 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

4NF313 

A 

1 

30 

33 

2.39 

0.17 

0.77 

0.59 

4NF313 

B 

0 

55 

60 

1.21 

0.08 

0.75 

-0.47 

4NF313 

C 

0 

7 

8 

0.99 

0.36 

0.71 

-0.18 

4NF313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF314 

* 

-1 

4670 

96 

0.99 

0.02 

0.00 

-0.04 

4NF314 

A 

1 

85 

40 

1.51 

0.10 

1.19 

0.27 

4NF314 

B 

0 

36 

17 

0.81 

0.14 

0.88 

-0.20 

4NF314 

C 

0 

93 

43 

1.09 

0.08 

1.17 

-0.11 

4NF314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF315 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4NF315 

A 

1 

51 

50 

2.02 

0.17 

1.37 

0.27 

4NF315 

B 

0 

27 

26 

1.54 

0.12 

1.05 

-0.11 

4NF315 

C 

0 

25 

24 

1.37 

0.17 

1.04 

-0.20 

4NF315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF32 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

4NF32 

A 

1 

76 

63 

1.56 

0.10 

1.06 

0.40 

4NF32 

B 

0 

37 

31 

0.93 

0.11 

0.97 

-0.28 

4NF32 

C 

0 

8 

7 

0.49 

0.23 

0.59 

-0.25 

4NF32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF33 

* 

-1 

4793 

98 

1.00 

0.02 

0.00 

-0.01 

4NF33 

A 

1 

69 

76 

1.23 

0.12 

1.02 

0.28 

4NF33 

B 

0 

8 

9 

0.40 

0.14 

0.67 

-0.22 

4NF33 

C 

0 

14 

15 

0.74 

0.22 

1.17 

-0.15 

4NF33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF34 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.05 

4NF34 

A 

1 

45 

47 

1.92 

0.16 

1.09 

0.44 

4NF34 

B 

0 

31 

33 

1.12 

0.11 

0.84 

-0.28 

4NF34 

C 

0 

19 

20 

1.09 

0.13 

0.79 

-0.22 

4NF34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF35 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4NF35 

A 

1 

73 

80 

1.72 

0.10 

0.98 

0.38 

4NF35 

B 

0 

9 

10 

1.06 

0.21 

0.92 

-0.18 

4NF35 

C 

0 

9 

10 

0.67 

0.18 

0.58 

-0.33 

4NF35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF36 

* 

-1 

4771 

98 

1.00 

0.02 

0.00 

-0.01 

4NF36 

A 

1 

80 

71 

1.29 

0.07 

0.85 

0.52 

4NF36 

B 

0 

23 

20 

0.44 

0.15 

0.78 

-0.41 

4NF36 

C 

0 

10 

9 

0.42 

0.15 

0.65 

-0.26 

4NF36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF37 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4NF37 

A 

1 

90 

82 

1.65 

0.09 

1.03 

0.28 

4NF37 

B 

0 

12 

11 

1.15 

0.23 

1.12 

-0.15 

4NF37 

C 

0 

8 

7 

0.77 

0.25 

0.73 

-0.24 

4NF37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF38 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

4NF38 

A 

1 

78 

86 

1.54 

0.11 

0.97 

0.28 

4NF38 

B 

0 

6 

7 

0.75 

0.21 

0.76 

-0.18 

4NF38 

C 

0 

7 

8 

0.74 

0.27 

0.86 

-0.20 

4NF38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF39 

* 

-1 

4782 

98 

0.98 

0.02 

0.00 

-0.10 

4NF39 

A 

1 

78 

76 

2.12 

0.09 

0.83 

0.55 

4NF39 

B 

0 

12 

12 

0.76 

0.15 

0.47 

-0.43 

4NF39 

C 

0 

12 

12 

1.10 

0.18 

0.69 

-0.29 

4NF39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF41 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4NF41 

A 

1 

51 

49 

1.40 

0.13 

1.33 

0.16 

4NF41 

B 

0 

23 

22 

1.29 

0.24 

2.03 

0.03 

4NF41 

C 

0 

30 

29 

0.92 

0.17 

1.02 

-0.20 

4NF41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF410 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4NF410 

A 

1 

29 

27 

2.18 

0.24 

1.53 

0.27 

4NF410 

B 

0 

62 

57 

1.67 

0.12 

1.25 

-0.03 

4NF410 

C 

0 

18 

17 

1.02 

0.18 

0.54 

-0.29 

4NF410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF411 

* 

-1 

4764 

98 

0.98 

0.02 

0.00 

-0.07 

4NF411 

A 

1 

88 

73 

1.91 

0.13 

0.99 

0.40 

4NF411 

B 

0 

16 

13 

0.67 

0.19 

0.71 

-0.29 

4NF411 

C 

0 

16 

13 

0.87 

0.25 

1.06 

-0.23 

4NF411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF412 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4NF412 

A 

1 

55 

52 

1.82 

0.17 

1.29 

0.13 

4NF412 

B 

0 

7 

7 

1.05 

0.37 

0.85 

-0.15 

4NF412 

C 

0 

43 

41 

1.62 

0.14 

1.54 

-0.05 

4NF412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF413 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.04 

4NF413 

A 

1 

51 

54 

1.80 

0.14 

0.95 

0.42 

4NF413 

B 

0 

30 

32 

0.71 

0.16 

0.88 

-0.47 

4NF413 

C 

0 

14 

15 

1.46 

0.15 

1.27 

0.02 

4NF413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF414 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.06 

4NF414 

A 

1 

30 

33 

2.05 

0.17 

1.06 

0.34 

4NF414 

B 

0 

16 

18 

1.75 

0.21 

1.69 

0.07 

4NF414 

C 

0 

44 

49 

1.23 

0.13 

1.00 

-0.37 

4NF414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF415 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4NF415 

A 

1 

59 

57 

2.07 

0.14 

1.04 

0.38 

4NF415 

B 

0 

29 

28 

1.26 

0.13 

0.87 

-0.29 

4NF415 

C 

0 

15 

15 

1.33 

0.27 

1.60 

-0.16 

4NF415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF416 

* 

-1 

4764 

98 

0.99 

0.02 

0.00 

-0.04 

4NF416 

A 

1 

60 

50 

1.77 

0.10 

0.86 

0.53 

4NF416 

B 

0 

15 

13 

0.43 

0.11 

0.46 

-0.38 

4NF416 

C 

0 

45 

38 

0.99 

0.12 

0.95 

-0.28 

4NF416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF417 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

4NF417 

A 

1 

62 

69 

1.36 

0.12 

0.94 

0.42 

4NF417 

B 

0 

6 

7 

0.00 

0.26 

0.47 

-0.31 

4NF417 

C 

0 

22 

24 

0.62 

0.12 

0.86 

-0.28 

4NF417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF418 

* 

-1 

4694 

96 

0.98 

0.02 

0.00 

-0.08 

4NF418 

A 

1 

88 

46 

2.02 

0.10 

0.91 

0.51 

4NF418 

B 

0 

82 

43 

1.10 

0.07 

0.81 

-0.40 

4NF418 

C 

0 

20 

11 

1.01 

0.19 

0.86 

-0.19 

4NF418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF419 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

4NF419 

A 

1 

30 

32 

1.95 

0.20 

1.18 

0.33 

4NF419 

B 

0 

37 

39 

1.34 

0.13 

1.05 

-0.14 

4NF419 

C 

0 

27 

29 

1.22 

0.16 

0.96 

-0.19 

4NF419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF42 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4NF42 

A 

1 

62 

68 

1.80 

0.11 

1.00 

0.39 

4NF42 

B 

0 

9 

10 

0.85 

0.20 

0.68 

-0.26 

4NF42 

C 

0 

20 

22 

1.12 

0.18 

1.22 

-0.26 

4NF42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF420 

* 

-1 

4773 

98 

1.00 

0.02 

0.00 

-0.01 

4NF420 

A 

1 

42 

38 

1.26 

0.12 

1.17 

0.22 

4NF420 

B 

0 

34 

31 

0.91 

0.12 

1.04 

-0.12 

4NF420 

C 

0 

35 

32 

0.92 

0.13 

1.08 

-0.11 

4NF420 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF43 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4NF43 

A 

1 

72 

65 

1.71 

0.10 

1.05 

0.27 

4NF43 

B 

0 

15 

14 

0.66 

0.17 

0.57 

-0.39 

4NF43 

C 

0 

23 

21 

1.55 

0.19 

1.68 

0.01 

4NF43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF44 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

4NF44 

A 

1 

39 

44 

1.60 

0.18 

1.26 

0.13 

4NF44 

B 

0 

23 

26 

1.03 

0.15 

0.89 

-0.25 

4NF44 

C 

0 

27 

30 

1.60 

0.18 

1.85 

0.10 

4NF44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF45 

* 

-1 

4786 

98 

0.98 

0.02 

0.00 

-0.10 

4NF45 

A 

1 

29 

30 

2.26 

0.17 

1.10 

0.28 

4NF45 

B 

0 

20 

20 

1.80 

0.21 

1.43 

-0.04 

4NF45 

C 

0 

49 

50 

1.69 

0.12 

1.00 

-0.22 

4NF45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


Item  ID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF46 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4NF46 

A 

1 

44 

42 

1.65 

0.15 

1.16 

0.35 

4NF46 

B 

0 

21 

20 

0.60 

0.21 

0.75 

-0.32 

4NF46 

C 

0 

39 

38 

1.12 

0.13 

1.11 

-0.09 

4NF46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF47 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4NF47 

A 

1 

74 

68 

2.06 

0.12 

0.91 

0.49 

4NF47 

B 

0 

23 

21 

1.02 

0.17 

0.81 

-0.33 

4NF47 

C 

0 

12 

11 

0.78 

0.14 

0.53 

-0.30 

4NF47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF48 

* 

-1 

4765 

98 

0.98 

0.02 

0.00 

-0.08 

4NF48 

A 

1 

71 

60 

2.10 

0.16 

1.26 

0.46 

4NF48 

B 

0 

32 

27 

0.90 

0.13 

0.79 

-0.34 

4NF48 

C 

0 

16 

13 

0.89 

0.19 

0.82 

-0.23 

4NF48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF49 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

4NF49 

A 

1 

43 

41 

2.33 

0.20 

0.97 

0.49 

4NF49 

B 

0 

29 

28 

1.23 

0.12 

0.82 

-0.25 

4NF49 

C 

0 

33 

31 

1.23 

0.13 

0.84 

-0.28 

4NF49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF51 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.04 

4NF51 

A 

1 

35 

37 

2.13 

0.17 

0.79 

0.54 

4NF51 

B 

0 

39 

41 

0.87 

0.12 

0.70 

-0.44 

4NF51 

C 

0 

21 

22 

1.20 

0.15 

0.91 

-0.11 

4NF51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF510 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.06 

4NF510 

A 

1 

13 

14 

2.52 

0.30 

0.90 

0.40 

4NF510 

B 

0 

16 

18 

1.36 

0.19 

0.78 

-0.11 

4NF510 

C 

0 

61 

68 

1.46 

0.11 

0.97 

-0.21 

4NF510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF511 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4NF511 

A 

1 

92 

89 

1.88 

0.10 

0.90 

0.40 

4NF511 

B 

0 

4 

4 

0.70 

0.31 

0.57 

-0.20 

4NF511 

C 

0 

7 

7 

0.47 

0.25 

0.48 

-0.33 

4NF511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF512 

* 

-1 

4764 

98 

0.99 

0.02 

0.00 

-0.04 

4NF512 

A 

1 

105 

88 

1.44 

0.08 

0.91 

0.42 

4NF512 

B 

0 

10 

8 

0.31 

0.18 

0.56 

-0.34 

4NF512 

C 

0 

5 

4 

0.38 

0.45 

0.76 

-0.22 

4NF512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF513 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

4NF513 

A 

1 

26 

29 

1.79 

0.21 

0.91 

0.47 

4NF513 

B 

0 

52 

58 

0.88 

0.11 

0.98 

-0.26 

4NF513 

C 

0 

12 

13 

0.48 

0.18 

0.55 

-0.25 

4NF513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF514 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

4NF514 

A 

1 

25 

27 

2.13 

0.23 

1.17 

0.41 

4NF514 

B 

0 

55 

59 

1.26 

0.10 

0.90 

-0.31 

4NF514 

C 

0 

14 

15 

1.32 

0.18 

0.86 

-0.08 

4NF514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF515 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4NF515 

A 

1 

15 

16 

2.13 

0.25 

1.04 

0.29 

4NF515 

B 

0 

12 

13 

1.10 

0.29 

0.90 

-0.20 

4NF515 

C 

0 

64 

70 

1.50 

0.10 

1.05 

-0.09 

4NF515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF516 

* 

-1 

4659 

95 

0.98 

0.02 

0.00 

-0.05 

4NF516 

A 

1 

198 

88 

1.35 

0.06 

1.01 

0.22 

4NF516 

B 

0 

25 

11 

0.86 

0.15 

1.12 

-0.18 

4NF516 

C 

0 

2 

1 

-0.42 

0.22 

0.24 

-0.19 

4NF516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF517 

* 

-1 

4775 

98 

1.00 

0.02 

0.00 

0.00 

4NF517 

A 

1 

80 

73 

1.16 

0.08 

1.03 

0.29 

4NF517 

B 

0 

18 

17 

0.45 

0.15 

0.76 

-0.35 

4NF517 

C 

0 

11 

10 

1.05 

0.16 

1.29 

0.01 

4NF517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF518 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4NF518 

A 

1 

90 

82 

1.67 

0.09 

0.99 

0.34 

4NF518 

B 

0 

15 

14 

0.78 

0.21 

0.84 

-0.33 

4NF518 

C 

0 

5 

5 

1.24 

0.22 

1.04 

-0.07 

4NF518 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF519 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

4NF519 

A 

1 

24 

27 

1.97 

0.27 

1.20 

0.32 

4NF519 

B 

0 

14 

16 

0.88 

0.19 

0.66 

-0.25 

4NF519 

C 

0 

51 

57 

1.37 

0.11 

1.15 

-0.10 

4NF519 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF52 

* 

-1 

4791 

98 

0.98 

0.02 

0.00 

-0.10 

4NF52 

A 

1 

21 

23 

2.19 

0.31 

1.80 

0.19 

4NF52 

B 

0 

65 

70 

1.84 

0.09 

0.99 

-0.07 

4NF52 

C 

0 

7 

8 

1.32 

0.18 

0.52 

-0.18 

4NF52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF520 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

4NF520 

A 

1 

88 

85 

1.40 

0.10 

0.92 

0.38 

4NF520 

B 

0 

7 

7 

-0.10 

0.29 

0.46 

-0.36 

4NF520 

C 

0 

9 

9 

0.68 

0.34 

1.17 

-0.17 

4NF520 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF53 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

4NF53 

A 

1 

35 

32 

2.22 

0.22 

1.39 

0.34 

4NF53 

B 

0 

49 

45 

1.49 

0.13 

1.08 

-0.18 

4NF53 

C 

0 

25 

23 

1.39 

0.14 

0.79 

-0.16 

4NF53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF54 

* 

-1 

4767 

98 

0.98 

0.02 

0.00 

-0.08 

4NF54 

A 

1 

99 

85 

1.79 

0.13 

1.04 

0.30 

4NF54 

B 

0 

12 

10 

0.51 

0.27 

0.75 

-0.30 

4NF54 

C 

0 

6 

5 

1.18 

0.26 

1.17 

-0.08 

4NF54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF55 

* 

-1 

4780 

98 

0.98 

0.02 

0.00 

-0.08 

4NF55 

A 

1 

28 

27 

2.57 

0.26 

0.89 

0.49 

4NF55 

B 

0 

40 

38 

1.37 

0.14 

1.00 

-0.22 

4NF55 

C 

0 

36 

35 

1.32 

0.10 

0.77 

-0.23 

4NF55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF56 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

4NF56 

A 

1 

27 

29 

2.09 

0.25 

1.35 

0.42 

4NF56 

B 

0 

59 

63 

1.19 

0.10 

0.89 

-0.29 

4NF56 

C 

0 

8 

9 

0.83 

0.26 

0.59 

-0.18 

4NF56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF57 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.06 

4NF57 

A 

1 

82 

92 

1.70 

0.10 

0.94 

0.33 

4NF57 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF57 

C 

0 

7 

8 

0.53 

0.26 

0.58 

-0.33 

4NF57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF58 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4NF58 

A 

1 

70 

68 

2.03 

0.13 

1.05 

0.41 

4NF58 

B 

0 

26 

25 

1.14 

0.11 

0.75 

-0.33 

4NF58 

C 

0 

7 

7 

1.02 

0.24 

0.69 

-0.19 

4NF58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF59 

* 

-1 

4765 

98 

0.99 

0.02 

0.00 

-0.04 

4NF59 

A 

1 

56 

47 

1.68 

0.10 

0.97 

0.40 

4NF59 

B 

0 

56 

47 

0.98 

0.11 

0.97 

-0.36 

4NF59 

C 

0 

7 

6 

1.05 

0.39 

1.14 

-0.07 

4NF59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF71 

* 

-1 

4795 

98 

1.00 

0.02 

0.00 

-0.01 

4NF71 

A 

1 

51 

57 

1.42 

0.13 

0.93 

0.39 

4NF71 

B 

0 

34 

38 

0.65 

0.16 

1.30 

-0.36 

4NF71 

C 

0 

4 

4 

0.77 

0.21 

0.84 

-0.07 

4NF71 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF710 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.05 

4NF710 

A 

1 

77 

84 

1.69 

0.10 

0.88 

0.46 

4NF710 

B 

0 

9 

10 

0.41 

0.15 

0.47 

-0.39 

4NF710 

C 

0 

6 

7 

0.72 

0.25 

0.70 

-0.22 

4NF710 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF711 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4NF711 

A 

1 

71 

78 

1.57 

0.11 

1.21 

0.03 

4NF711 

B 

0 

16 

18 

1.60 

0.17 

1.59 

0.02 

4NF711 

C 

0 

4 

4 

1.14 

0.24 

0.89 

-0.10 

4NF711 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF712 

* 

-1 

4778 

98 

1.00 

0.02 

0.00 

0.00 

4NF712 

A 

1 

89 

84 

1.09 

0.08 

1.00 

0.21 

4NF712 

B 

0 

4 

4 

0.85 

0.27 

1.12 

-0.05 

4NF712 

C 

0 

13 

12 

0.61 

0.27 

1.25 

-0.20 

4NF712 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF713 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4NF713 

A 

1 

97 

88 

1.66 

0.08 

0.92 

0.40 

4NF713 

B 

0 

3 

3 

0.47 

0.71 

0.75 

-0.20 

4NF713 

C 

0 

10 

9 

0.59 

0.20 

0.63 

-0.33 

4NF713 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF714 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

4NF714 

A 

1 

27 

30 

2.41 

0.20 

0.63 

0.64 

4NF714 

B 

0 

14 

16 

1.34 

0.22 

1.15 

-0.05 

4NF714 

C 

0 

48 

54 

0.94 

0.08 

0.65 

-0.55 

4NF714 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF715 

* 

-1 

4794 

98 

0.98 

0.02 

0.00 

-0.09 

4NF715 

A 

1 

36 

40 

2.23 

0.17 

1.11 

0.32 

4NF715 

B 

0 

5 

6 

1.13 

0.23 

0.50 

-0.20 

4NF715 

C 

0 

49 

54 

1.69 

0.11 

1.04 

-0.23 

4NF715 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF72 

* 

-1 

4781 

98 

0.99 

0.02 

0.00 

-0.03 

4NF72 

A 

1 

88 

85 

1.39 

0.10 

0.98 

0.35 

4NF72 

B 

0 

10 

10 

0.40 

0.31 

0.92 

-0.27 

4NF72 

C 

0 

5 

5 

0.34 

0.27 

0.65 

-0.20 

4NF72 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF73 

* 

-1 

4776 

98 

0.98 

0.02 

0.00 

-0.08 

4NF73 

A 

1 

72 

67 

2.01 

0.12 

0.96 

0.44 

4NF73 

B 

0 

26 

24 

0.94 

0.16 

0.80 

-0.40 

4NF73 

C 

0 

10 

9 

1.25 

0.13 

0.83 

-0.13 

4NF73 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF74 

* 

-1 

4767 

98 

0.98 

0.02 

0.00 

-0.08 

4NF74 

A 

1 

101 

86 

1.76 

0.13 

1.04 

0.26 

4NF74 

B 

0 

15 

13 

0.86 

0.27 

1.22 

-0.23 

4NF74 

C 

0 

1 

1 

-0.28 

0.00 

0.24 

-0.14 

4NF74 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF75 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

4NF75 

A 

1 

44 

48 

1.93 

0.14 

0.96 

0.45 

4NF75 

B 

0 

44 

48 

1.14 

0.11 

0.98 

-0.37 

4NF75 

C 

0 

3 

3 

0.42 

0.07 

0.35 

-0.21 

4NF75 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF76 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

4NF76 

A 

1 

79 

87 

1.69 

0.10 

0.93 

0.38 

4NF76 

B 

0 

9 

10 

0.61 

0.22 

0.59 

-0.35 

4NF76 

C 

0 

3 

3 

0.88 

0.25 

0.71 

-0.14 

4NF76 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4NF77 

* 

-1 

4670 

96 

0.98 

0.02 

0.00 

-0.08 

4NF77 

A 

1 

158 

74 

1.73 

0.08 

0.98 

0.41 

4NF77 

B 

0 

35 

16 

0.83 

0.15 

1.06 

-0.27 

4NF77 

C 

0 

21 

10 

0.63 

0.18 

0.73 

-0.27 

4NF77 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF78 

* 

-1 

4780 

98 

1.00 

0.02 

0.00 

0.00 

4NF78 

A 

1 

59 

57 

1.24 

0.09 

1.02 

0.33 

4NF78 

B 

0 

26 

25 

0.62 

0.15 

0.91 

-0.31 

4NF78 

C 

0 

19 

18 

0.89 

0.16 

1.14 

-0.08 

4NF78 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4NF79 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4NF79 

A 

1 

92 

84 

1.61 

0.09 

1.08 

0.21 

4NF79 

B 

0 

17 

15 

1.11 

0.19 

1.15 

-0.20 

4NF79 

C 

0 

1 

1 

1.27 

0.00 

0.98 

-0.03 

4NF79 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40  A 1 1 

* 

-1 

4776 

98 

0.98 

0.02 

0.00 

-0.08 

40  A 1 1 

A 

1 

65 

60 

1.95 

0.15 

1.11 

0.31 

40A11 

B 

0 

36 

33 

1.38 

0.12 

1.13 

-0.19 

40  A 1 1 

C 

0 

7 

6 

0.58 

0.24 

0.47 

-0.26 

40  A 1 1 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4OA110 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

4OA110 

A 

1 

78 

81 

1.61 

0.11 

0.90 

0.41 

4OA110 

B 

0 

4 

4 

0.73 

0.55 

1.00 

-0.14 

4OA110 

C 

0 

14 

15 

0.49 

0.20 

0.67 

-0.38 

4OA110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A111 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

40A111 

A 

1 

72 

78 

1.75 

0.11 

0.99 

0.33 

40A111 

B 

0 

7 

8 

0.91 

0.30 

0.82 

-0.20 

40A111 

C 

0 

13 

14 

1.02 

0.18 

0.86 

-0.24 

40A111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A112 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

40A112 

A 

1 

90 

85 

1.89 

0.10 

0.89 

0.38 

40A112 

B 

0 

7 

7 

1.44 

0.26 

1.27 

-0.07 

40A112 

C 

0 

9 

8 

0.28 

0.19 

0.37 

-0.43 

40A112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A113 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

40A113 

A 

1 

52 

43 

1.46 

0.13 

1.38 

0.16 

40A113 

B 

0 

3 

2 

0.42 

1.00 

1.00 

-0.16 

40A113 

C 

0 

66 

55 

1.21 

0.09 

1.15 

-0.11 

40A113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A114 

* 

-1 

4791 

98 

1.00 

0.02 

0.00 

-0.01 

40A114 

A 

1 

79 

85 

1.16 

0.10 

1.02 

0.17 

40A114 

B 

0 

8 

9 

0.91 

0.39 

1.86 

-0.06 

40A114 

C 

0 

6 

6 

0.45 

0.31 

0.86 

-0.18 

40A114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A115 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.06 

40A115 

A 

1 

80 

83 

1.58 

0.10 

1.03 

0.18 

40A115 

B 

0 

15 

16 

1.20 

0.22 

1.33 

-0.14 

40A115 

C 

0 

1 

1 

0.29 

0.00 

0.38 

-0.13 

40A115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A116 

* 

-1 

4791 

98 

0.99 

0.02 

0.00 

-0.06 

40A116 

A 

1 

81 

87 

1.68 

0.10 

0.92 

0.37 

40A116 

B 

0 

3 

3 

0.92 

0.15 

0.72 

-0.12 

40A116 

C 

0 

9 

10 

0.56 

0.27 

0.65 

-0.35 

40A116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A117 

* 

-1 

4770 

98 

1.00 

0.02 

0.00 

-0.01 

40A117 

A 

1 

79 

69 

1.28 

0.07 

0.88 

0.47 

40A117 

B 

0 

27 

24 

0.48 

0.15 

0.83 

-0.42 

40A117 

C 

0 

8 

7 

0.64 

0.13 

0.79 

-0.15 

40A117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A118 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

40A118 

A 

1 

103 

94 

1.61 

0.08 

0.93 

0.35 

40A118 

B 

0 

5 

5 

0.02 

0.30 

0.38 

-0.37 

40A118 

C 

0 

2 

2 

1.14 

0.00 

0.94 

-0.06 

40A118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A119 

* 

-1 

4680 

96 

0.97 

0.02 

0.00 

-0.09 

40A119 

A 

1 

179 

88 

1.67 

0.08 

0.96 

0.30 

40A119 

B 

0 

15 

7 

0.67 

0.22 

0.81 

-0.23 

40A119 

C 

0 

10 

5 

0.70 

0.25 

0.83 

-0.18 

40A119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A12 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.05 

40A12 

A 

1 

63 

68 

1.66 

0.13 

0.96 

0.35 

40A12 

B 

0 

13 

14 

1.01 

0.21 

1.09 

-0.17 

40A12 

C 

0 

16 

17 

0.81 

0.15 

0.79 

-0.28 

40A12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4OA120 

* 

-1 

4776 

98 

0.98 

0.02 

0.00 

-0.10 

4OA120 

A 

1 

84 

78 

2.01 

0.10 

0.95 

0.38 

4OA120 

B 

0 

22 

20 

1.27 

0.16 

0.90 

-0.31 

4OA120 

C 

0 

2 

2 

0.28 

0.15 

0.26 

-0.23 

4OA120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A121 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

40A121 

A 

1 

62 

60 

1.70 

0.11 

0.91 

0.56 

40A121 

B 

0 

40 

38 

0.61 

0.11 

0.73 

-0.50 

40A121 

C 

0 

2 

2 

-0.26 

0.45 

0.27 

-0.21 

40A121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A122 

* 

-1 

4774 

98 

0.98 

0.02 

0.00 

-0.08 

40A122 

A 

1 

66 

60 

2.10 

0.13 

0.91 

0.47 

40A122 

B 

0 

22 

20 

1.26 

0.18 

1.03 

-0.20 

40A122 

C 

0 

22 

20 

0.92 

0.16 

0.67 

-0.37 

40A122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A123 

* 

-1 

4762 

98 

0.98 

0.02 

0.00 

-0.07 

40A123 

A 

1 

47 

39 

1.80 

0.21 

1.94 

0.14 

40A123 

B 

0 

52 

43 

1.61 

0.16 

2.06 

0.02 

40A123 

C 

0 

23 

19 

1.07 

0.22 

0.99 

-0.19 

40A123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A124 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

40A124 

A 

1 

66 

62 

2.01 

0.14 

0.95 

0.40 

40A124 

B 

0 

16 

15 

1.03 

0.20 

0.89 

-0.24 

40A124 

C 

0 

24 

23 

1.14 

0.16 

0.94 

-0.26 

40A124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A125 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

40A125 

A 

1 

70 

73 

1.56 

0.12 

1.08 

0.25 

40A125 

B 

0 

18 

19 

1.27 

0.18 

1.48 

-0.07 

40A125 

C 

0 

8 

8 

0.37 

0.31 

0.65 

-0.31 

40A125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A13 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

40A13 

A 

1 

48 

52 

1.88 

0.14 

1.05 

0.33 

40A13 

B 

0 

15 

16 

0.96 

0.20 

0.78 

-0.29 

40A13 

C 

0 

29 

32 

1.40 

0.15 

1.20 

-0.13 

40A13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A14 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

40A14 

A 

1 

82 

78 

1.95 

0.11 

0.90 

0.42 

40A14 

B 

0 

19 

18 

0.98 

0.19 

0.96 

-0.34 

40A14 

C 

0 

4 

4 

0.53 

0.39 

0.47 

-0.23 

40A14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A15 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

40A15 

A 

1 

94 

78 

1.43 

0.09 

1.02 

0.28 

40A15 

B 

0 

20 

17 

0.99 

0.17 

1.17 

-0.16 

40A15 

C 

0 

7 

6 

0.44 

0.38 

0.85 

-0.24 

40A15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


489 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A16 

* 

-1 

4792 

98 

1.00 

0.02 

0.00 

-0.01 

40A16 

A 

1 

71 

77 

1.29 

0.11 

0.93 

0.40 

40A16 

B 

0 

13 

14 

0.37 

0.16 

0.71 

-0.31 

40A16 

C 

0 

8 

9 

0.44 

0.26 

0.82 

-0.21 

40A16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A17 

* 

-1 

4684 

96 

0.97 

0.02 

0.00 

-0.10 

40A17 

A 

1 

123 

62 

1.91 

0.09 

1.06 

0.35 

40A17 

B 

0 

21 

11 

1.05 

0.12 

0.72 

-0.21 

40A17 

C 

0 

56 

28 

1.26 

0.10 

1.04 

-0.24 

40A17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A18 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.05 

40A18 

A 

1 

74 

78 

1.73 

0.10 

0.87 

0.49 

40A18 

B 

0 

10 

11 

0.89 

0.20 

0.84 

-0.23 

40A18 

C 

0 

11 

12 

0.44 

0.13 

0.47 

-0.41 

40A18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A19 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

40A19 

A 

1 

63 

69 

1.70 

0.12 

1.08 

0.25 

40A19 

B 

0 

12 

13 

1.28 

0.20 

1.15 

-0.12 

40A19 

C 

0 

16 

18 

1.18 

0.20 

1.04 

-0.19 

40A19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A21 

* 

-1 

4770 

98 

1.00 

0.02 

0.00 

-0.01 

40A21 

A 

1 

105 

92 

1.14 

0.07 

0.90 

0.45 

40A21 

B 

0 

3 

3 

-0.24 

0.40 

0.41 

-0.28 

40A21 

C 

0 

6 

5 

-0.05 

0.17 

0.45 

-0.35 

40A21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4OA210 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

4OA210 

A 

1 

60 

55 

1.87 

0.10 

0.93 

0.41 

4OA210 

B 

0 

34 

31 

1.33 

0.13 

1.12 

-0.15 

4OA210 

C 

0 

16 

15 

0.69 

0.21 

0.61 

-0.39 

4OA210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A22 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.05 

40A22 

A 

1 

32 

35 

1.94 

0.23 

1.14 

0.38 

40A22 

B 

0 

7 

8 

0.67 

0.19 

0.51 

-0.22 

40A22 

C 

0 

53 

58 

1.20 

0.09 

1.00 

-0.25 

40A22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A23 

* 

-1 

4780 

98 

0.98 

0.02 

0.00 

-0.10 

40A23 

A 

1 

73 

70 

2.03 

0.10 

0.99 

0.32 

40A23 

B 

0 

20 

19 

1.52 

0.20 

1.23 

-0.17 

40A23 

C 

0 

11 

11 

1.13 

0.20 

0.71 

-0.26 

40A23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A24 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

40A24 

A 

1 

79 

76 

1.46 

0.10 

1.00 

0.39 

40A24 

B 

0 

6 

6 

0.68 

0.28 

0.87 

-0.14 

40A24 

C 

0 

19 

18 

0.50 

0.23 

1.02 

-0.35 

40A24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A25 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

40A25 

A 

1 

92 

84 

1.94 

0.10 

0.83 

0.52 

40A25 

B 

0 

12 

11 

0.32 

0.10 

0.37 

-0.46 

40A25 

C 

0 

5 

5 

0.66 

0.39 

0.63 

-0.22 

40A25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A26 

* 

-1 

4764 

98 

0.98 

0.02 

0.00 

-0.07 

40A26 

A 

1 

104 

87 

1.81 

0.12 

0.89 

0.41 

40A26 

B 

0 

5 

4 

0.24 

0.42 

0.54 

-0.22 

40A26 

C 

0 

11 

9 

0.31 

0.22 

0.55 

-0.32 

40A26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A27 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

40A27 

A 

1 

85 

81 

1.90 

0.12 

0.93 

0.40 

40A27 

B 

0 

8 

8 

0.84 

0.17 

0.65 

-0.22 

40A27 

C 

0 

12 

11 

0.74 

0.18 

0.65 

-0.31 

40A27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A28 

* 

-1 

4788 

98 

0.99 

0.02 

0.00 

-0.05 

40A28 

A 

1 

68 

71 

1.62 

0.12 

1.03 

0.33 

40A28 

B 

0 

24 

25 

1.03 

0.16 

1.08 

-0.22 

40A28 

C 

0 

4 

4 

0.08 

0.25 

0.35 

-0.28 

40A28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A29 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

40A29 

A 

1 

57 

62 

1.96 

0.11 

0.82 

0.51 

40A29 

B 

0 

11 

12 

0.78 

0.17 

0.60 

-0.31 

40A29 

C 

0 

24 

26 

1.04 

0.17 

0.95 

-0.34 

40A29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A31 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

40A31 

A 

1 

45 

44 

2.28 

0.16 

0.96 

0.46 

40A31 

B 

0 

36 

35 

1.17 

0.12 

0.71 

-0.40 

40A31 

C 

0 

22 

21 

1.55 

0.18 

1.19 

-0.09 

40A31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4OA310 

* 

-1 

4763 

98 

0.99 

0.02 

0.00 

-0.04 

4OA310 

A 

1 

94 

78 

1.46 

0.09 

1.01 

0.35 

4OA310 

B 

0 

17 

14 

0.63 

0.18 

0.80 

-0.31 

4OA310 

C 

0 

10 

8 

0.89 

0.11 

0.85 

-0.14 

4OA310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A311 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

40A311 

A 

1 

36 

40 

1.41 

0.18 

1.24 

0.27 

40A311 

B 

0 

16 

18 

0.88 

0.22 

1.13 

-0.10 

40A311 

C 

0 

38 

42 

0.88 

0.12 

1.18 

-0.19 

40A311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A312 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

40A312 

A 

1 

39 

41 

1.83 

0.17 

1.21 

0.30 

40A312 

B 

0 

33 

35 

1.10 

0.12 

0.80 

-0.32 

40A312 

C 

0 

22 

23 

1.52 

0.16 

1.26 

0.01 

40A312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A313 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

40A313 

A 

1 

45 

49 

2.06 

0.13 

0.83 

0.56 

40A313 

B 

0 

34 

37 

1.08 

0.12 

0.81 

-0.41 

40A313 

C 

0 

12 

13 

1.00 

0.13 

0.65 

-0.24 

40A313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A314 

* 

-1 

4773 

98 

1.00 

0.02 

0.00 

-0.01 

40A314 

A 

1 

40 

36 

1.43 

0.12 

0.96 

0.39 

40A314 

B 

0 

33 

30 

0.90 

0.13 

1.00 

-0.13 

40A314 

C 

0 

38 

34 

0.76 

0.10 

0.84 

-0.27 

40A314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A315 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

40A315 

A 

1 

56 

51 

1.75 

0.14 

1.36 

0.25 

40A315 

B 

0 

29 

26 

1.21 

0.13 

0.93 

-0.22 

40A315 

C 

0 

25 

23 

1.42 

0.13 

1.11 

-0.07 

40A315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A316 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

40A316 

A 

1 

54 

59 

1.87 

0.14 

0.85 

0.54 

40A316 

B 

0 

20 

22 

0.81 

0.12 

0.71 

-0.33 

40A316 

C 

0 

17 

19 

0.75 

0.10 

0.63 

-0.33 

40A316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A317 

* 

-1 

4785 

98 

0.98 

0.02 

0.00 

-0.10 

40A317 

A 

1 

58 

59 

2.23 

0.11 

0.90 

0.47 

40A317 

B 

0 

28 

28 

1.38 

0.14 

0.88 

-0.33 

40A317 

C 

0 

13 

13 

1.27 

0.22 

0.84 

-0.25 

40A317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A318 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

40A318 

A 

1 

69 

66 

1.58 

0.11 

0.92 

0.48 

40A318 

B 

0 

11 

11 

0.14 

0.21 

0.47 

-0.38 

40A318 

C 

0 

24 

23 

0.76 

0.17 

0.97 

-0.26 

40A318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A319 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

40A319 

A 

1 

88 

81 

1.93 

0.11 

0.95 

0.44 

40A319 

B 

0 

7 

6 

0.52 

0.21 

0.47 

-0.29 

40A319 

C 

0 

14 

13 

0.84 

0.15 

0.68 

-0.31 

40A319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A32 

* 

-1 

4764 

98 

0.98 

0.02 

0.00 

-0.07 

40A32 

A 

1 

76 

63 

2.06 

0.15 

1.06 

0.47 

40A32 

B 

0 

14 

12 

0.80 

0.28 

1.05 

-0.23 

40A32 

C 

0 

30 

25 

0.82 

0.13 

0.74 

-0.36 

40A32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4OA320 

* 

-1 

4685 

96 

0.97 

0.02 

0.00 

-0.11 

4OA320 

A 

1 

144 

72 

1.65 

0.07 

1.13 

-0.01 

4OA320 

B 

0 

41 

21 

2.10 

0.19 

3.80 

0.23 

4OA320 

C 

0 

14 

7 

0.42 

0.16 

0.41 

-0.34 

4OA320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A33 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

40A33 

A 

1 

63 

60 

1.99 

0.15 

1.03 

0.34 

40A33 

B 

0 

7 

7 

0.83 

0.27 

0.62 

-0.21 

40A33 

C 

0 

35 

33 

1.30 

0.12 

1.03 

-0.25 

40A33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A34 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.04 

40A34 

A 

1 

63 

66 

1.67 

0.13 

0.97 

0.37 

40A34 

B 

0 

13 

14 

1.12 

0.23 

1.12 

-0.11 

40A34 

C 

0 

19 

20 

0.72 

0.19 

0.81 

-0.34 

40A34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A35 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.06 

40A35 

A 

1 

58 

64 

1.96 

0.12 

0.84 

0.52 

40A35 

B 

0 

16 

18 

1.01 

0.18 

0.78 

-0.29 

40A35 

C 

0 

16 

18 

0.86 

0.18 

0.71 

-0.36 

40A35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A36 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

40A36 

A 

1 

40 

39 

2.28 

0.16 

0.96 

0.42 

40A36 

B 

0 

47 

46 

1.42 

0.13 

1.06 

-0.28 

40A36 

C 

0 

16 

16 

1.31 

0.24 

1.00 

-0.18 

40A36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A37 

* 

-1 

4764 

98 

0.99 

0.02 

0.00 

-0.04 

40A37 

A 

1 

98 

82 

1.46 

0.09 

1.00 

0.38 

40A37 

B 

0 

12 

10 

0.72 

0.18 

0.83 

-0.22 

40A37 

C 

0 

10 

8 

0.48 

0.19 

0.63 

-0.29 

40A37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40  A3  8 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

40  A3  8 

A 

1 

70 

78 

1.22 

0.12 

1.04 

0.26 

40  A3  8 

B 

0 

12 

13 

0.76 

0.17 

1.04 

-0.14 

40  A3  8 

C 

0 

8 

9 

0.43 

0.25 

0.79 

-0.22 

40  A3  8 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A39 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

40A39 

A 

1 

73 

78 

1.70 

0.11 

0.95 

0.39 

40A39 

B 

0 

12 

13 

0.93 

0.20 

0.86 

-0.23 

40A39 

C 

0 

9 

10 

0.67 

0.15 

0.60 

-0.29 

40A39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A41 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

40A41 

A 

1 

64 

70 

1.76 

0.11 

0.97 

0.35 

40A41 

B 

0 

15 

16 

1.00 

0.16 

0.78 

-0.27 

40A41 

C 

0 

12 

13 

1.17 

0.31 

1.52 

-0.17 

40A41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4OA410 

* 

-1 

4773 

98 

1.00 

0.02 

0.00 

-0.01 

4OA410 

A 

1 

106 

95 

1.08 

0.07 

0.98 

0.23 

4OA410 

B 

0 

3 

3 

0.34 

0.30 

0.69 

-0.16 

4OA410 

C 

0 

2 

2 

0.08 

0.72 

0.63 

-0.17 

4OA410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Fourth  Grade  Math  Measure  Development 


495 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A411 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

40A411 

A 

1 

103 

94 

1.63 

0.08 

0.88 

0.43 

40A411 

B 

0 

1 

1 

1.40 

0.00 

1.21 

-0.01 

40A411 

C 

0 

6 

5 

-0.16 

0.14 

0.27 

-0.46 

40A411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A412 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

40A412 

A 

1 

74 

83 

1.60 

0.12 

0.97 

0.32 

40A412 

B 

0 

9 

10 

0.86 

0.18 

0.85 

-0.20 

40A412 

C 

0 

6 

7 

0.56 

0.17 

0.58 

-0.24 

40A412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A413 

* 

-1 

4789 

98 

0.98 

0.02 

0.00 

-0.09 

40A413 

A 

1 

69 

73 

2.06 

0.11 

0.97 

0.36 

40A413 

B 

0 

12 

13 

1.42 

0.13 

0.85 

-0.19 

40A413 

C 

0 

14 

15 

1.27 

0.25 

0.98 

-0.27 

40A413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A414 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

40A414 

A 

1 

62 

60 

1.71 

0.10 

0.78 

0.58 

40A414 

B 

0 

20 

19 

0.18 

0.17 

0.53 

-0.52 

40A414 

C 

0 

22 

21 

0.87 

0.16 

0.96 

-0.19 

40A414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A415 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

40A415 

A 

1 

81 

74 

2.06 

0.11 

0.79 

0.58 

40A415 

B 

0 

16 

15 

0.58 

0.16 

0.50 

-0.44 

40A415 

C 

0 

12 

11 

0.74 

0.16 

0.56 

-0.32 

40A415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A416 

* 

-1 

4765 

98 

0.98 

0.02 

0.00 

-0.08 

40A416 

A 

1 

99 

83 

1.87 

0.12 

0.87 

0.46 

40A416 

B 

0 

6 

5 

0.33 

0.34 

0.56 

-0.23 

40A416 

C 

0 

14 

12 

0.32 

0.19 

0.53 

-0.37 

40A416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A417 

* 

-1 

4694 

96 

0.98 

0.02 

0.00 

-0.08 

40A417 

A 

1 

144 

76 

1.76 

0.07 

0.91 

0.47 

40A417 

B 

0 

19 

10 

0.65 

0.14 

0.61 

-0.32 

40A417 

C 

0 

27 

14 

0.84 

0.09 

0.68 

-0.30 

40A417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A418 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

40A418 

A 

1 

65 

62 

1.94 

0.15 

1.14 

0.30 

40A418 

B 

0 

20 

19 

1.12 

0.16 

0.92 

-0.25 

40A418 

C 

0 

20 

19 

1.42 

0.16 

1.23 

-0.12 

40A418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A419 

* 

-1 

4789 

98 

0.99 

0.02 

0.00 

-0.04 

40A419 

A 

1 

42 

44 

1.74 

0.15 

1.06 

0.29 

40A419 

B 

0 

36 

38 

1.05 

0.16 

1.09 

-0.27 

40A419 

C 

0 

17 

18 

1.33 

0.24 

1.48 

-0.04 

40A419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A42 

* 

-1 

4794 

98 

0.99 

0.02 

0.00 

-0.06 

40A42 

A 

1 

67 

74 

1.91 

0.11 

0.84 

0.55 

40A42 

B 

0 

11 

12 

0.70 

0.21 

0.62 

-0.35 

40A42 

C 

0 

12 

13 

0.71 

0.11 

0.53 

-0.37 

40A42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4OA420 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

4OA420 

A 

1 

36 

35 

2.17 

0.17 

1.12 

0.31 

4OA420 

B 

0 

30 

29 

1.71 

0.19 

1.73 

-0.01 

4OA420 

C 

0 

37 

36 

1.33 

0.15 

0.91 

-0.29 

4OA420 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A421 

* 

-1 

4765 

98 

0.99 

0.02 

0.00 

-0.04 

40A421 

A 

1 

36 

30 

1.63 

0.15 

1.19 

0.24 

40A421 

B 

0 

45 

38 

1.24 

0.13 

1.13 

-0.07 

40A421 

C 

0 

38 

32 

1.10 

0.13 

0.95 

-0.16 

40A421 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A422 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

40A422 

A 

1 

58 

64 

1.34 

0.13 

1.00 

0.36 

40A422 

B 

0 

10 

11 

0.44 

0.18 

0.68 

-0.24 

40A422 

C 

0 

22 

24 

0.71 

0.17 

1.12 

-0.22 

40A422 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A423 

* 

-1 

4791 

98 

0.99 

0.02 

0.00 

-0.06 

40A423 

A 

1 

61 

66 

1.83 

0.11 

0.88 

0.48 

40A423 

B 

0 

20 

22 

0.97 

0.15 

0.85 

-0.30 

40A423 

C 

0 

12 

13 

0.77 

0.22 

0.74 

-0.31 

40A423 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A424 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

40A424 

A 

1 

48 

53 

1.71 

0.12 

1.12 

0.19 

40A424 

B 

0 

26 

29 

1.44 

0.22 

1.88 

-0.08 

40A424 

C 

0 

17 

19 

1.28 

0.13 

0.92 

-0.14 

40A424 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A425 

* 

-1 

4776 

98 

1.00 

0.02 

0.00 

0.00 

40A425 

A 

1 

36 

33 

0.96 

0.12 

1.49 

-0.07 

40A425 

B 

0 

51 

47 

1.21 

0.10 

1.41 

0.23 

40A425 

C 

0 

21 

19 

0.71 

0.18 

0.89 

-0.21 

40A425 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A43 

* 

-1 

4670 

96 

0.98 

0.02 

0.00 

-0.08 

40A43 

A 

1 

89 

42 

1.95 

0.12 

1.16 

0.38 

40A43 

B 

0 

49 

23 

1.15 

0.11 

0.91 

-0.17 

40A43 

C 

0 

76 

36 

1.13 

0.11 

0.97 

-0.25 

40A43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A44 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

40A44 

A 

1 

87 

79 

1.77 

0.08 

0.84 

0.52 

40A44 

B 

0 

12 

11 

0.51 

0.20 

0.55 

-0.40 

40A44 

C 

0 

11 

10 

0.79 

0.24 

0.77 

-0.28 

40A44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A45 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

40A45 

A 

1 

44 

49 

1.89 

0.17 

0.96 

0.44 

40A45 

B 

0 

38 

43 

1.03 

0.10 

0.89 

-0.37 

40A45 

C 

0 

7 

8 

0.99 

0.30 

0.90 

-0.13 

40A45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A46 

* 

-1 

4793 

98 

0.98 

0.02 

0.00 

-0.09 

40A46 

A 

1 

63 

69 

1.99 

0.11 

1.03 

0.20 

40A46 

B 

0 

14 

15 

1.54 

0.23 

1.16 

-0.16 

40A46 

C 

0 

14 

15 

1.65 

0.32 

2.23 

-0.10 

40A46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A47 

* 

-1 

4780 

98 

0.99 

0.02 

0.00 

-0.03 

40A47 

A 

1 

58 

56 

1.65 

0.12 

0.91 

0.46 

40A47 

B 

0 

16 

15 

0.81 

0.20 

0.92 

-0.18 

40A47 

C 

0 

30 

29 

0.68 

0.18 

0.90 

-0.36 

40A47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A48 

* 

-1 

4775 

98 

0.98 

0.02 

0.00 

-0.08 

40A48 

A 

1 

54 

50 

2.02 

0.15 

1.21 

0.30 

40A48 

B 

0 

26 

24 

1.49 

0.16 

1.14 

-0.11 

40A48 

C 

0 

29 

27 

1.30 

0.18 

1.11 

-0.23 

40A48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A49 

* 

-1 

4767 

98 

0.98 

0.02 

0.00 

-0.08 

40A49 

A 

1 

96 

82 

1.88 

0.13 

0.97 

0.43 

40A49 

B 

0 

3 

3 

0.98 

0.33 

0.89 

-0.08 

40A49 

C 

0 

18 

15 

0.38 

0.17 

0.56 

-0.42 

40A49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A51 

* 

-1 

4780 

98 

0.98 

0.02 

0.00 

-0.08 

40A51 

A 

1 

77 

74 

1.88 

0.13 

1.07 

0.32 

40A51 

B 

0 

9 

9 

1.03 

0.21 

0.84 

-0.18 

40A51 

C 

0 

18 

17 

1.11 

0.12 

0.84 

-0.23 

40A51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4OA510 

* 

-1 

4790 

98 

0.99 

0.02 

0.00 

-0.05 

4OA510 

A 

1 

49 

52 

1.62 

0.17 

1.42 

0.21 

4OA510 

B 

0 

16 

17 

1.35 

0.24 

1.56 

-0.03 

4OA510 

C 

0 

29 

31 

1.12 

0.11 

0.90 

-0.20 

4OA510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A511 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.06 

40A511 

A 

1 

57 

64 

1.94 

0.13 

0.99 

0.47 

40A511 

B 

0 

29 

33 

0.98 

0.11 

0.71 

-0.46 

40A511 

C 

0 

3 

3 

1.32 

0.22 

0.89 

-0.06 

40A511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A512 

* 

-1 

4781 

98 

0.98 

0.02 

0.00 

-0.08 

40A512 

A 

1 

82 

80 

1.89 

0.11 

1.01 

0.29 

40A512 

B 

0 

15 

15 

1.22 

0.20 

1.00 

-0.21 

40A512 

C 

0 

6 

6 

0.95 

0.39 

0.92 

-0.19 

40A512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A513 

* 

-1 

4765 

98 

0.99 

0.02 

0.00 

-0.04 

40A513 

A 

1 

94 

79 

1.54 

0.08 

0.87 

0.51 

40A513 

B 

0 

12 

10 

0.42 

0.23 

0.66 

-0.34 

40A513 

C 

0 

13 

11 

0.49 

0.17 

0.66 

-0.33 

40A513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A514 

* 

-1 

4795 

98 

1.00 

0.02 

0.00 

-0.01 

40A514 

A 

1 

78 

88 

1.13 

0.11 

1.07 

0.11 

40A514 

B 

0 

4 

4 

0.36 

0.30 

0.72 

-0.17 

40A514 

C 

0 

7 

8 

1.09 

0.17 

1.43 

0.00 

40A514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A515 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.05 

40A515 

A 

1 

61 

67 

1.74 

0.12 

0.96 

0.37 

40A515 

B 

0 

14 

15 

0.79 

0.19 

0.76 

-0.32 

40A515 

C 

0 

16 

18 

1.20 

0.21 

1.23 

-0.15 

40A515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A516 

* 

-1 

4793 

98 

0.99 

0.02 

0.00 

-0.06 

40A516 

A 

1 

43 

47 

2.07 

0.14 

0.89 

0.54 

40A516 

B 

0 

27 

30 

0.93 

0.08 

0.59 

-0.45 

40A516 

C 

0 

21 

23 

1.30 

0.15 

0.93 

-0.16 

40A516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A517 

* 

-1 

4779 

98 

1.00 

0.02 

0.00 

0.00 

40A517 

A 

1 

36 

34 

1.27 

0.14 

1.24 

0.24 

40A517 

B 

0 

61 

58 

0.92 

0.09 

1.06 

-0.15 

40A517 

C 

0 

8 

8 

0.65 

0.12 

0.67 

-0.14 

40A517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A518 

* 

-1 

4774 

98 

0.99 

0.02 

0.00 

-0.06 

40A518 

A 

1 

66 

60 

1.79 

0.09 

0.89 

0.36 

40A518 

B 

0 

32 

29 

1.31 

0.19 

1.52 

-0.16 

40A518 

C 

0 

12 

11 

0.69 

0.20 

0.57 

-0.33 

40A518 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A519 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

40A519 

A 

1 

32 

36 

1.80 

0.21 

1.20 

0.26 

40A519 

B 

0 

35 

39 

1.39 

0.15 

1.43 

-0.05 

40A519 

C 

0 

22 

25 

1.04 

0.15 

0.84 

-0.24 

40A519 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A52 

* 

-1 

4795 

98 

0.98 

0.02 

0.00 

-0.09 

40A52 

A 

1 

79 

89 

1.99 

0.10 

0.95 

0.36 

40A52 

B 

0 

7 

8 

0.93 

0.18 

0.57 

-0.30 

40A52 

C 

0 

3 

3 

0.99 

0.22 

0.58 

-0.18 

40A52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4OA520 

* 

-1 

4781 

98 

0.99 

0.02 

0.00 

-0.03 

4OA520 

A 

1 

48 

47 

1.67 

0.14 

1.09 

0.40 

4OA520 

B 

0 

39 

38 

0.80 

0.15 

0.93 

-0.34 

4OA520 

C 

0 

16 

16 

1.01 

0.21 

1.03 

-0.10 

4OA520 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A53 

* 

-1 

4776 

98 

0.98 

0.02 

0.00 

-0.08 

40A53 

A 

1 

64 

59 

2.08 

0.14 

1.04 

0.45 

40A53 

B 

0 

19 

18 

1.20 

0.19 

0.89 

-0.21 

40A53 

C 

0 

25 

23 

1.04 

0.12 

0.69 

-0.33 

40A53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A54 

* 

-1 

4660 

95 

0.97 

0.02 

0.00 

-0.11 

40A54 

A 

1 

116 

52 

2.14 

0.11 

1.09 

0.42 

40A54 

B 

0 

49 

22 

1.29 

0.12 

1.10 

-0.17 

40A54 

C 

0 

59 

26 

1.02 

0.12 

0.83 

-0.32 

40A54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A55 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

40A55 

A 

1 

54 

61 

1.88 

0.13 

0.80 

0.53 

40A55 

B 

0 

20 

22 

0.91 

0.15 

0.87 

-0.30 

40A55 

C 

0 

15 

17 

0.65 

0.12 

0.57 

-0.37 

40A55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A56 

* 

-1 

4660 

95 

0.98 

0.02 

0.00 

-0.05 

40A56 

A 

1 

73 

33 

1.64 

0.10 

1.17 

0.29 

40A56 

B 

0 

67 

30 

0.89 

0.09 

0.81 

-0.30 

40A56 

C 

0 

84 

38 

1.29 

0.09 

1.23 

0.00 

40A56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A57 

* 

-1 

4795 

98 

0.98 

0.02 

0.00 

-0.09 

40A57 

A 

1 

50 

56 

2.21 

0.13 

0.99 

0.42 

40A57 

B 

0 

9 

10 

1.28 

0.23 

0.74 

-0.21 

40A57 

C 

0 

30 

34 

1.48 

0.12 

0.89 

-0.31 

40A57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

40A58 

* 

-1 

4781 

98 

0.99 

0.02 

0.00 

-0.03 

40A58 

A 

1 

21 

20 

1.96 

0.22 

1.11 

0.37 

40A58 

B 

0 

44 

43 

0.86 

0.14 

0.80 

-0.33 

40A58 

C 

0 

38 

37 

1.28 

0.15 

1.11 

0.03 

40A58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

SCORE 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

40A59 

* 

-1 

4768 

98 

0.98 

0.02 

0.00 

-0.08 

40A59 

A 

1 

45 

39 

2.57 

0.18 

0.86 

0.58 

40A59 

B 

0 

26 

22 

1.00 

0.21 

0.91 

-0.27 

40A59 

C 

0 

45 

39 

1.06 

0.13 

0.82 

-0.35 

40A59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

